-- Logs begin at Tue 2022-07-12 13:48:33 UTC, end at Tue 2022-07-12 14:52:14 UTC. -- Jul 12 14:19:03.399727 dv-cinder-836996-39-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 14:19:03.408449 dv-cinder-836996-39-smb devstack@keystone.service[80435]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 14:19:03 2022] *** Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: nodename: dv-cinder-836996-39-smb Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: machine: x86_64 Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: clock source: unix Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: pcre jit disabled Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: detected number of CPU cores: 4 Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: current working directory: / Jul 12 14:19:03.410450 dv-cinder-836996-39-smb devstack@keystone.service[80435]: detected binary path: /usr/bin/uwsgi-core Jul 12 14:19:03.411258 dv-cinder-836996-39-smb devstack@keystone.service[80435]: your processes number limit is 47680 Jul 12 14:19:03.411258 dv-cinder-836996-39-smb devstack@keystone.service[80435]: your memory page size is 4096 bytes Jul 12 14:19:03.411258 dv-cinder-836996-39-smb devstack@keystone.service[80435]: detected max file descriptor number: 2048 Jul 12 14:19:03.411258 dv-cinder-836996-39-smb devstack@keystone.service[80435]: lock engine: pthread robust mutexes Jul 12 14:19:03.411258 dv-cinder-836996-39-smb devstack@keystone.service[80435]: thunder lock: enabled Jul 12 14:19:03.411258 dv-cinder-836996-39-smb devstack@keystone.service[80435]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 14:19:03.411258 dv-cinder-836996-39-smb devstack@keystone.service[80435]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 14:19:03.456579 dv-cinder-836996-39-smb devstack@keystone.service[80435]: Python main interpreter initialized at 0x561b0575e9c0 Jul 12 14:19:03.456579 dv-cinder-836996-39-smb devstack@keystone.service[80435]: python threads support enabled Jul 12 14:19:03.456579 dv-cinder-836996-39-smb devstack@keystone.service[80435]: your server socket listen backlog is limited to 100 connections Jul 12 14:19:03.456579 dv-cinder-836996-39-smb devstack@keystone.service[80435]: your mercy for graceful operations on workers is 90 seconds Jul 12 14:19:03.456946 dv-cinder-836996-39-smb devstack@keystone.service[80435]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 14:19:03.457019 dv-cinder-836996-39-smb devstack@keystone.service[80435]: *** Operational MODE: preforking *** Jul 12 14:19:03.457267 dv-cinder-836996-39-smb devstack@keystone.service[80435]: *** uWSGI is running in multiple interpreter mode *** Jul 12 14:19:03.457267 dv-cinder-836996-39-smb devstack@keystone.service[80435]: spawned uWSGI master process (pid: 80435) Jul 12 14:19:03.457473 dv-cinder-836996-39-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 14:19:03.458898 dv-cinder-836996-39-smb devstack@keystone.service[80435]: spawned uWSGI worker 1 (pid: 80443, cores: 1) Jul 12 14:19:03.458898 dv-cinder-836996-39-smb devstack@keystone.service[80435]: spawned uWSGI worker 2 (pid: 80444, cores: 1) Jul 12 14:19:03.458898 dv-cinder-836996-39-smb devstack@keystone.service[80435]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 14:19:08.904381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:19:08.904381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: from cryptography.utils import int_from_bytes Jul 12 14:19:08.905179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:19:08.905179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: from cryptography.utils import int_from_bytes Jul 12 14:19:08.905179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:19:08.905179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: from cryptography.utils import int_from_bytes Jul 12 14:19:08.905685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:19:08.905685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: from cryptography.utils import int_from_bytes Jul 12 14:19:08.954147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:19:08.954345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:19:08.954431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:19:08.954556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:19:08.954635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] command line args: [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:19:08.954750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] command line args: [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:19:08.954893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:19:08.955044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:19:08.955121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ================================================================================ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:19:08.955224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ================================================================================ {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:19:08.955374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] admin_token = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.955479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] admin_token = **** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.955667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] config_dir = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.955749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] config_dir = [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.955902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.955977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.956087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] config_source = [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.956170 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] config_source = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.956270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] debug = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.956463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] debug = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.956538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.957795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.957896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.957957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] list_limit = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958475 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] log_config_append = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] log_config_append = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] log_dir = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] log_dir = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] log_file = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] log_file = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.958977 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.959975 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.960089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.960201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.960314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.960434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.960547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.960666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.960786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.960905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.961960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.962246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.962362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.962482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] publish_errors = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.962594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] publish_errors = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.962711 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.962861 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.962988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.963108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.963220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.963337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.963456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.963586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.963707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.963820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.963937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] standard_threads = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.964056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] standard_threads = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.964168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.964348 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.964471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.964590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.964709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.964828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.964946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] use_journal = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.965068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] use_journal = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.965187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] use_json = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.965305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] use_json = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.965423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] use_stderr = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.965543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] use_stderr = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.965667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] use_syslog = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.965780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] use_syslog = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.965891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.966002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:19:08.966119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.966238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.966361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.966475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.966641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.966763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.966904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.967964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.968066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.968177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.968294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.968413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.968536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.968652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.968770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.968898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.969011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.969123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.969243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.969361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.969474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.969586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.969698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.969816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.970006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.970121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.970234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.970347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.970465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.970579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.970699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.970891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.971915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.972948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.973987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.974108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.974222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.974332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.974443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.974559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.974672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.974817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.974935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.975048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.975166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.975285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.975398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.975625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.975749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.975861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.975976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.976878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.977102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.977214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.977325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.977436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.977547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.977665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.977785 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.977897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.978964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.979902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980126 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.980940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.981061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.981660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.981784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.981899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.982939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.983068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.983193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.983315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.983429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.983531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.983641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.983762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.983882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.984953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.985996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.986115 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.986229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.986341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.986455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.986576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.986690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.986853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.986971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.987084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.987196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.987384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.987509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.987630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.987743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.987856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.987969 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.988090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.988213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.988338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.988453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.988567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.988680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.988794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.988906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.989956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.990076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.990191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.990303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.990427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.990542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.990662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.990796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.990913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] auth.external = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.external = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] auth.password = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.991984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.992111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] auth.token = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.992227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.992340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.992454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.password = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.992567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.992690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.token = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.992806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.992926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.993979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] credential.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.994101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.994216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.994330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.994443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.994557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.994670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.994810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.994928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.995971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.996084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.996206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.996321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.996436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.996436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.996648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.996648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.997521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.997641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.997756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.997870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.997985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.998099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.998225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.998349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] federation.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.998466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.998580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.998694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.998832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.998962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.999080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.999195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.999309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.999424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.999538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.999661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.999777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:08.999891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.000938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.001061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.001177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.001306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.001421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.001536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.001649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.001847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.001965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.002079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.002194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.002309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.002431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.002553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.002669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.002799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.002916 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.003988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.004101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.004215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.004330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.004444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.004565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.004681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.004795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.004909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.005962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.006078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.006192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.006306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.006421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.006535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.006657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.006815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.006933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.007990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.008145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.008263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.008383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.008500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.008613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.008727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.008849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.008964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.009985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.010098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.010220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.010335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.010449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.010563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.010676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.010808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.010940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.011989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.012103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.012217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.012339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.012477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.012592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.012707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.012820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.012934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.013056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.013172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.013292 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.013407 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.013522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.013635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.013759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.013880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.014981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.015107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.015224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.015338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.015452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.015565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.015679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.015802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.015917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.016950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.017996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.018110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.018230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.018345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.018459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.018580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.018696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.018822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.018938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.019983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.020099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.020213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.020327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.020440 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.020554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.020676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.020791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.020905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021018 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] resource.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.021943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.022068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.022186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.022299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.022414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.022527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.022641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.022763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.022909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.023024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.023138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.023252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.023365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.023491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.023608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.023988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.024107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.024224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.024338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.024523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] role.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.024641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.024755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] role.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.024870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.024983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.025098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.025220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.025343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] role.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.025458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.025573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] role.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.025687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.025801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.025923 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026733 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.026981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.027095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.027220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.027337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.027451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.027565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.027680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.027794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.027916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028168 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.028979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.029093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.029207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.029330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.029446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.029446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.029662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.029776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.029890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.030973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.031087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.031201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.031315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.031440 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.031563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.031677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.031794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.031908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] token.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.032949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033176 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] token.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.033983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.034104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.034219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.034333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.034446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.034560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.034674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.034814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.034931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.035964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.036076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.036198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.036313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.036427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.036539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.036653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.036767 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.connection = **** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.036893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.037954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.038993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.039106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.039220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.039344 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.039460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.039574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.039688 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.039801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.039915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.040956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.041069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.041182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:19:09.041296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.041296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.041296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.041296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:19:09.041726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:19:09.071757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.071997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.072085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.072236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.072330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.072521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.080642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.081115 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.108850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.109085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.109176 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.109339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.251569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.252056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.300566 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.300803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.301125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.301365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.365082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.365313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.365529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.365630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.365751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.365832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.365970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.366052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.366186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.366276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.366403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.366621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.390033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.390215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.390367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.390450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.390523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.390671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.390753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.390974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.391053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.391124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.391195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.391340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.391422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.391556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.402680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.402799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.415887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.416991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.417071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.417207 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.417286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.417425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:19:09.434928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.435140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 14:19:09.435526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.435704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.435799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 14:19:09.435908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 14:19:09.436067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.436179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.436260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 14:19:09.436437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.436524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.436692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.436770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.436943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.437022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.437274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.447830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.448107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.448214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.448372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.448496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.448649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.448769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.449056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.456949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.457419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.460280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.460564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.460749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.460850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.461032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.461123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.461317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.461396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.461605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.461685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.461892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.461973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.462157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.462236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.462424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.462502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.462695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.462794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.462988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.463067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.463270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.463541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.490606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.491387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.492262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.492541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.493026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.493310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.497849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.498131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.498414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.498683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.498992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.499397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.505933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.506179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.506762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.507083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.510684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.510995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.511279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.511563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.511653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.511845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.511927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.512120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.512201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.512388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.512513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.512681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.512762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.512988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.513261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.513531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.532340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.532618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.533249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.533537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.537238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.538212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.540914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.541210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.541919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.542219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.546981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.547972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.550622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.551648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.554325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.554625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.554940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.555233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.555335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.555511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.555637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.555789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.555940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.556229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.556523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.556806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.575655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.575948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.576217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.576488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.576755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.577070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.577341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.577617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.584564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.585699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.586286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.586565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.587453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.587736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.589906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.590193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.590478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.591352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.591636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.591730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.591921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.592206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.592492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.592772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.605030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.605315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.605596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.605874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.606162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.606258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.606460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.606545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.606742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.606837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.607070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.607357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.609081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.609374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.626300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.627514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.629635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.630885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.632974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.634219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.634596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.636001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.636413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.636691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.636976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.638180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.638464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.638753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.644847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.646261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.646470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.647933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.650010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.650311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.650594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.650907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.651483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.651777 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.652174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.652457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.660748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.661041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.661319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.662236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.662533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.662843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.669303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.669582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.669864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.670142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.670413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.670690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.670846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:19:09.670987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.671133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.671260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.671417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.671638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.671717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.671915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.671996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.672190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.672317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.672446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.672600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.672719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.672888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.673001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.673173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.673450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.673732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.674000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.674270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.674549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:19:09.711451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b0575e9c0 pid: 80444 (default app) Jul 12 14:19:09.713314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b0575e9c0 pid: 80443 (default app) Jul 12 14:19:09.714830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81bb78-d14f-4916-8efc-a4e82da28267 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:09.715130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81bb78-d14f-4916-8efc-a4e82da28267 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:09.715419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81bb78-d14f-4916-8efc-a4e82da28267 None None] PATH_INFO: `/v3` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:09.720137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 791 bytes} [Tue Jul 12 14:19:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:17.223837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da040359-13a1-4a64-836f-5d2c5bf16d9c None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:17.224378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da040359-13a1-4a64-836f-5d2c5bf16d9c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:17.224462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da040359-13a1-4a64-836f-5d2c5bf16d9c None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:17.228745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1/2] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:17.234718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:17.235135 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:17.235305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:17.306347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: INFO dbcounter [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] Registered counter for database keystone Jul 12 14:19:17.328138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG oslo_db.sqlalchemy.engines [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:19:17.334301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writer thread running {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:19:17.509804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG passlib.handlers.bcrypt [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80444) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 14:19:17.510226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG passlib.handlers.bcrypt [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80444) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 14:19:17.565418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:17.567082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:17.687415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 14:19:17.868066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da040359-13a1-4a64-836f-5d2c5bf16d9c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:17.937813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: INFO dbcounter [None req-da040359-13a1-4a64-836f-5d2c5bf16d9c None None] Registered counter for database keystone Jul 12 14:19:17.957082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG oslo_db.sqlalchemy.engines [None req-da040359-13a1-4a64-836f-5d2c5bf16d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:19:17.963183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writer thread running {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:19:18.080437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da040359-13a1-4a64-836f-5d2c5bf16d9c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:18.084687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3d86f-0fbe-4dc0-a4ab-34eebbfecd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:18.085355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d86f-0fbe-4dc0-a4ab-34eebbfecd85 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:18.085645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d86f-0fbe-4dc0-a4ab-34eebbfecd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:18.085925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d86f-0fbe-4dc0-a4ab-34eebbfecd85 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:18.094562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3d86f-0fbe-4dc0-a4ab-34eebbfecd85 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:18.146154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00e3d86f-0fbe-4dc0-a4ab-34eebbfecd85 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 14:19:18.146494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3d86f-0fbe-4dc0-a4ab-34eebbfecd85 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:18.156703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 2/4] 10.222.0.72 () {58 vars in 1324 bytes} [Tue Jul 12 14:19:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:19:18.162874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:18.177108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df86f5-3329-41cd-bda8-49c6583b92e9 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:18.181433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aec00b-efae-4547-af1f-92163931c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:18.182543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec00b-efae-4547-af1f-92163931c145 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:18.182867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec00b-efae-4547-af1f-92163931c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:18.183149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec00b-efae-4547-af1f-92163931c145 admin admin] PATH_INFO: `/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:18.184621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aec00b-efae-4547-af1f-92163931c145 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3334aa68e9e41b9ae01ceb2502f9b38)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:18.239538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING keystone.common.rbac_enforcer.enforcer [None req-58aec00b-efae-4547-af1f-92163931c145 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 14:19:18.240136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aec00b-efae-4547-af1f-92163931c145 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:18.244435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 3/5] 10.222.0.72 () {56 vars in 1207 bytes} [Tue Jul 12 14:19:18 2022] GET /identity/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:20.214133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2a55-09ff-43ed-8e4a-26df7f3375cd None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:20.214629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2a55-09ff-43ed-8e4a-26df7f3375cd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:20.214725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2a55-09ff-43ed-8e4a-26df7f3375cd None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:20.219390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 3/6] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:20.224620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fed36-13e7-4e0a-b224-c3686556f4a5 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:20.225026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fed36-13e7-4e0a-b224-c3686556f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:20.225191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fed36-13e7-4e0a-b224-c3686556f4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:20.243587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-cf0fed36-13e7-4e0a-b224-c3686556f4a5 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:20.245101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-cf0fed36-13e7-4e0a-b224-c3686556f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:20.252928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 4/7] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 14:19:20.275517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2a55-09ff-43ed-8e4a-26df7f3375cd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:20.287993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2a55-09ff-43ed-8e4a-26df7f3375cd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:20.292128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476740a-2505-41a1-b638-0b474ce057bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:20.292757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476740a-2505-41a1-b638-0b474ce057bf admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:20.293045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476740a-2505-41a1-b638-0b474ce057bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:20.293328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476740a-2505-41a1-b638-0b474ce057bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:20.301006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476740a-2505-41a1-b638-0b474ce057bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:20.302830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476740a-2505-41a1-b638-0b474ce057bf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:20.311445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 4/8] 10.222.0.72 () {58 vars in 1324 bytes} [Tue Jul 12 14:19:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:19:20.316839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fed36-13e7-4e0a-b224-c3686556f4a5 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:20.326255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fed36-13e7-4e0a-b224-c3686556f4a5 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:20.330635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34e94e-0922-494c-a33a-6fe140fe1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:20.331541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e94e-0922-494c-a33a-6fe140fe1ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:20.331830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e94e-0922-494c-a33a-6fe140fe1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:20.332113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e94e-0922-494c-a33a-6fe140fe1ba4 admin admin] PATH_INFO: `/v3/users/117ad82133d0435087c48fd76e0b6541` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:20.333494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34e94e-0922-494c-a33a-6fe140fe1ba4 admin admin] RBAC: Authorizing `identity:get_user(user_id=117ad82133d0435087c48fd76e0b6541)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:20.335373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34e94e-0922-494c-a33a-6fe140fe1ba4 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:20.336936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 5/9] 10.222.0.72 () {56 vars in 1198 bytes} [Tue Jul 12 14:19:20 2022] GET /identity/v3/users/117ad82133d0435087c48fd76e0b6541 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:22.395790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38d99c-3337-44f2-9f3b-c56fd3f3cfac None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:22.396290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38d99c-3337-44f2-9f3b-c56fd3f3cfac None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:22.396384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38d99c-3337-44f2-9f3b-c56fd3f3cfac None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:22.397700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 5/10] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:22.403091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e978fe-910d-4f7f-b789-0081f4ef6e98 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:22.403479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e978fe-910d-4f7f-b789-0081f4ef6e98 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:22.403785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e978fe-910d-4f7f-b789-0081f4ef6e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:22.418611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937489b-8977-46df-bdfa-b63d39aa192d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:22.418934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937489b-8977-46df-bdfa-b63d39aa192d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:22.419219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937489b-8977-46df-bdfa-b63d39aa192d None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:22.420523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 6/11] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:19:22.421102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-09e978fe-910d-4f7f-b789-0081f4ef6e98 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:22.422390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-09e978fe-910d-4f7f-b789-0081f4ef6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:22.425273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:22.425567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:22.425851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:22.464395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG passlib.handlers.bcrypt [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80443) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 14:19:22.464811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG passlib.handlers.bcrypt [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80443) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 14:19:22.505069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 6/12] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:22.510027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:22.511673 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:22.528661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e978fe-910d-4f7f-b789-0081f4ef6e98 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:22.552072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:22.613265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 7/13] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:22.630198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e978fe-910d-4f7f-b789-0081f4ef6e98 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:22.634664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:22.663669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbad6e-27b1-4c51-b815-0f04864863b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:22.664398 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbad6e-27b1-4c51-b815-0f04864863b4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:22.664679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbad6e-27b1-4c51-b815-0f04864863b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:22.664955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbad6e-27b1-4c51-b815-0f04864863b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:22.675730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbad6e-27b1-4c51-b815-0f04864863b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-dfcbad6e-27b1-4c51-b815-0f04864863b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:22.686857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:22.687888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:22.688859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 7/14] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:19:22.693731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbad6e-27b1-4c51-b815-0f04864863b4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:22.736541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2baefc-316e-4f75-a750-a37aa8b53f6b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:22.738797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:22.774697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f65b3-f986-4f30-b43b-c0e5c40d1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:22.775876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:22.775986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f65b3-f986-4f30-b43b-c0e5c40d1236 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:22.776186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f65b3-f986-4f30-b43b-c0e5c40d1236 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:22.776467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f65b3-f986-4f30-b43b-c0e5c40d1236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:22.793816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbad6e-27b1-4c51-b815-0f04864863b4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:22.827858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:22.828526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:22.828816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:22.829098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:22.829852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:22.830168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:22.831615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:22.843514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 8/15] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:22.843634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f65b3-f986-4f30-b43b-c0e5c40d1236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:22.845075 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f65b3-f986-4f30-b43b-c0e5c40d1236 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:22.849063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:22.941746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 8/16] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:19:22.947536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f65b3-f986-4f30-b43b-c0e5c40d1236 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:22.950622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:22.951876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5714-b8d2-4749-a3aa-7359aa15eb00 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:22.983669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175ca73-b9c5-40e0-91d9-8bac98aeae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:22.984549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175ca73-b9c5-40e0-91d9-8bac98aeae0e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:22.984837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175ca73-b9c5-40e0-91d9-8bac98aeae0e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:22.985113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175ca73-b9c5-40e0-91d9-8bac98aeae0e None admin] PATH_INFO: `/v3/users/117ad82133d0435087c48fd76e0b6541` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:22.986300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175ca73-b9c5-40e0-91d9-8bac98aeae0e None admin] RBAC: Authorizing `identity:get_user(user_id=117ad82133d0435087c48fd76e0b6541)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:22.987790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175ca73-b9c5-40e0-91d9-8bac98aeae0e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:22.989390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 9/17] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:22 2022] GET /identity/v3/users/117ad82133d0435087c48fd76e0b6541 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:22.994722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175ca73-b9c5-40e0-91d9-8bac98aeae0e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:23.009115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:23.045653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f65b3-f986-4f30-b43b-c0e5c40d1236 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:23.079717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:23.080534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:23.080832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:23.081118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:23.095400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175ca73-b9c5-40e0-91d9-8bac98aeae0e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:23.099217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:23.100697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:19:23.121439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:23.122360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:23.123768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:19:23.123768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:19:23.123768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:19:23.123768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:23.123768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 9/18] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:19:23.128879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:23.129711 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5fc3d-b0b6-41f4-aed9-70904063696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:23.130521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5fc3d-b0b6-41f4-aed9-70904063696d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:23.130835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5fc3d-b0b6-41f4-aed9-70904063696d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:23.131121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5fc3d-b0b6-41f4-aed9-70904063696d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:23.132289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5fc3d-b0b6-41f4-aed9-70904063696d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:23.133752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5fc3d-b0b6-41f4-aed9-70904063696d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:23.135376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 10/19] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:23.141030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5fc3d-b0b6-41f4-aed9-70904063696d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:23.184233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:23.219628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:23.227599 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c12e-fd89-4b36-a93e-9707ed1f2c60 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:23.239262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5fc3d-b0b6-41f4-aed9-70904063696d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:23.261393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ad63f-6163-4dc0-9d8c-0b986a6f94ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:23.262064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad63f-6163-4dc0-9d8c-0b986a6f94ef None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:23.262350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad63f-6163-4dc0-9d8c-0b986a6f94ef None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:23.262632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad63f-6163-4dc0-9d8c-0b986a6f94ef None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:23.263410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad63f-6163-4dc0-9d8c-0b986a6f94ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:23.263728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad63f-6163-4dc0-9d8c-0b986a6f94ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:23.265123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad63f-6163-4dc0-9d8c-0b986a6f94ef None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:23.271631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053545c8-9da3-4f1c-bc8f-3c0bbce7a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:23.272286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053545c8-9da3-4f1c-bc8f-3c0bbce7a51b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:23.272573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053545c8-9da3-4f1c-bc8f-3c0bbce7a51b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:23.272854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053545c8-9da3-4f1c-bc8f-3c0bbce7a51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:23.273682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053545c8-9da3-4f1c-bc8f-3c0bbce7a51b None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.domain.id=default, user.id=117ad82133d0435087c48fd76e0b6541) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:23.273997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053545c8-9da3-4f1c-bc8f-3c0bbce7a51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:23.275736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053545c8-9da3-4f1c-bc8f-3c0bbce7a51b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:23.282086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 10/20] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:23.282474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 11/21] 10.222.0.72 () {56 vars in 1322 bytes} [Tue Jul 12 14:19:23 2022] GET /identity/v3/role_assignments?user.id=117ad82133d0435087c48fd76e0b6541&scope.domain.id=default&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:25.427768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f491-f608-473f-9d6f-951b86f4a9f0 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:25.428280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f491-f608-473f-9d6f-951b86f4a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:25.428359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f491-f608-473f-9d6f-951b86f4a9f0 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:25.429976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 11/22] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:25.435109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493424b-5b45-441c-8abc-ac9e52a5a27f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:25.435910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493424b-5b45-441c-8abc-ac9e52a5a27f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:25.436332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493424b-5b45-441c-8abc-ac9e52a5a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:25.459905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5493424b-5b45-441c-8abc-ac9e52a5a27f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:25.461364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5493424b-5b45-441c-8abc-ac9e52a5a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:25.552676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 12/23] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:25.594060 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030f491-f608-473f-9d6f-951b86f4a9f0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:25.731626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030f491-f608-473f-9d6f-951b86f4a9f0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:25.754661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:25.777144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed922e-7a01-4ab1-b398-331bf6c8cbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:25.777965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed922e-7a01-4ab1-b398-331bf6c8cbba None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:25.778257 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed922e-7a01-4ab1-b398-331bf6c8cbba None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:25.778541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed922e-7a01-4ab1-b398-331bf6c8cbba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:25.798540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed922e-7a01-4ab1-b398-331bf6c8cbba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-55ed922e-7a01-4ab1-b398-331bf6c8cbba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:25.807585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:25.808365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:25.809102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 12/24] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:25.816586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493424b-5b45-441c-8abc-ac9e52a5a27f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:25.937412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:25.959191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad096fa-4de9-4038-a389-3ef949ee1f1a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:25.959492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad096fa-4de9-4038-a389-3ef949ee1f1a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:25.959779 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad096fa-4de9-4038-a389-3ef949ee1f1a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:25.961429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 13/25] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:25.967869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493424b-5b45-441c-8abc-ac9e52a5a27f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:25.981782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dbef3-7e86-408b-a5c2-5dde9efac354 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:25.982068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dbef3-7e86-408b-a5c2-5dde9efac354 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:25.982324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dbef3-7e86-408b-a5c2-5dde9efac354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.008328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:26.009380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.009885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.010379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.011390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:26.011903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:26.013628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:26.023381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 13/26] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:26.029181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:26.030276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-228dbef3-7e86-408b-a5c2-5dde9efac354 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:26.033444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-228dbef3-7e86-408b-a5c2-5dde9efac354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:26.188848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 14/27] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:26.190267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927e8a3-0289-4dfd-8166-7bcffcce6589 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.190567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927e8a3-0289-4dfd-8166-7bcffcce6589 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.190873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927e8a3-0289-4dfd-8166-7bcffcce6589 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.192135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 15/28] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:26.198601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ff383-66fc-43a6-b437-9541524db085 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:26.202046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c641b-88e8-4173-aa55-38d2e1661a67 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.202336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c641b-88e8-4173-aa55-38d2e1661a67 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.202618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c641b-88e8-4173-aa55-38d2e1661a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.225017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-959c641b-88e8-4173-aa55-38d2e1661a67 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:26.226226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-959c641b-88e8-4173-aa55-38d2e1661a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:26.245705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb0824-a26a-4806-994f-e32024a751cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:26.246534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb0824-a26a-4806-994f-e32024a751cd None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.246852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb0824-a26a-4806-994f-e32024a751cd None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.247138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb0824-a26a-4806-994f-e32024a751cd None admin] PATH_INFO: `/v3/users/117ad82133d0435087c48fd76e0b6541` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.249463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb0824-a26a-4806-994f-e32024a751cd None admin] RBAC: Authorizing `identity:get_user(user_id=117ad82133d0435087c48fd76e0b6541)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:26.251289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb0824-a26a-4806-994f-e32024a751cd None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:26.253533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 14/29] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:26 2022] GET /identity/v3/users/117ad82133d0435087c48fd76e0b6541 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:26.255339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7074-036a-4a5b-a27f-02054e1ad513 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.255634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7074-036a-4a5b-a27f-02054e1ad513 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.255919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7074-036a-4a5b-a27f-02054e1ad513 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.257157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 15/30] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:26.259807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7074-036a-4a5b-a27f-02054e1ad513 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:26.263925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:26.309752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 16/31] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:26.311257 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c641b-88e8-4173-aa55-38d2e1661a67 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:26.354476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:26.421506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7074-036a-4a5b-a27f-02054e1ad513 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:26.428407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c641b-88e8-4173-aa55-38d2e1661a67 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:26.464896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa32345-7b9a-4a0f-a4e0-37d651424a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:26.465708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa32345-7b9a-4a0f-a4e0-37d651424a81 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.466186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa32345-7b9a-4a0f-a4e0-37d651424a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.466613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa32345-7b9a-4a0f-a4e0-37d651424a81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.467312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:26.468102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.468395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.468678 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.469971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa32345-7b9a-4a0f-a4e0-37d651424a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:26.471723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa32345-7b9a-4a0f-a4e0-37d651424a81 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:26.473541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 17/32] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:26.475047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ee6f-29a0-40af-a27f-5c9ce6c9fa49 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.475532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ee6f-29a0-40af-a27f-5c9ce6c9fa49 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.475983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ee6f-29a0-40af-a27f-5c9ce6c9fa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.487122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:26.488623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:26.495072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1f84ee6f-29a0-40af-a27f-5c9ce6c9fa49 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:26.496636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1f84ee6f-29a0-40af-a27f-5c9ce6c9fa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:19:26.510110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:26.511109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:26.512113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:19:26.512113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:19:26.512113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:19:26.512113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:26.516124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 16/33] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:26.516928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:26.579572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:26.599736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 18/34] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:26.600770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84ee6f-29a0-40af-a27f-5c9ce6c9fa49 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:26.639845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:26.650926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320c30-0748-425c-9c27-7e7cef8a0d26 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:26.687043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50014b-c048-423b-abed-4243cc0a8029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:26.687943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50014b-c048-423b-abed-4243cc0a8029 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.688381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50014b-c048-423b-abed-4243cc0a8029 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.688798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50014b-c048-423b-abed-4243cc0a8029 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.689687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50014b-c048-423b-abed-4243cc0a8029 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:26.691282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50014b-c048-423b-abed-4243cc0a8029 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:26.714270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84ee6f-29a0-40af-a27f-5c9ce6c9fa49 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:26.752315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c891651-f465-42fd-ab44-a7ddc14624fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:26.753290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c891651-f465-42fd-ab44-a7ddc14624fe None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:26.753701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c891651-f465-42fd-ab44-a7ddc14624fe None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:26.754136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c891651-f465-42fd-ab44-a7ddc14624fe None admin] PATH_INFO: `/v3/domains/default/users/117ad82133d0435087c48fd76e0b6541/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:26.756533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c891651-f465-42fd-ab44-a7ddc14624fe None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=117ad82133d0435087c48fd76e0b6541, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:26.758155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c891651-f465-42fd-ab44-a7ddc14624fe None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:26.831680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 17/35] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jul 12 14:19:26 2022] POST /identity/v3/roles => generated 225 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:26.840374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50014b-c048-423b-abed-4243cc0a8029 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:26.888892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 19/36] 10.222.0.72 () {58 vars in 1361 bytes} [Tue Jul 12 14:19:26 2022] PUT /identity/v3/domains/default/users/117ad82133d0435087c48fd76e0b6541/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:19:26.895875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c891651-f465-42fd-ab44-a7ddc14624fe None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:27.090520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50014b-c048-423b-abed-4243cc0a8029 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:27.091276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:27.108735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c891651-f465-42fd-ab44-a7ddc14624fe None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:27.114062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:27.137797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6436d-2797-4451-8ba7-f0ad36dfa14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:27.138485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6436d-2797-4451-8ba7-f0ad36dfa14f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.138851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6436d-2797-4451-8ba7-f0ad36dfa14f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.139150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6436d-2797-4451-8ba7-f0ad36dfa14f None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.139900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6436d-2797-4451-8ba7-f0ad36dfa14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:27.140212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6436d-2797-4451-8ba7-f0ad36dfa14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:27.141882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6436d-2797-4451-8ba7-f0ad36dfa14f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:27.161352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58fda9-cb41-4ac1-be70-6ad147122837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:27.162269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 18/37] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:27.166794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c0c0-8adb-4afc-bc1c-4fd5762b4f5d None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.166794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c0c0-8adb-4afc-bc1c-4fd5762b4f5d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.166794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c0c0-8adb-4afc-bc1c-4fd5762b4f5d None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.166794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 19/38] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:27.167395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fda9-cb41-4ac1-be70-6ad147122837 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.167927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fda9-cb41-4ac1-be70-6ad147122837 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.168433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fda9-cb41-4ac1-be70-6ad147122837 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.169434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58fda9-cb41-4ac1-be70-6ad147122837 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:27.171331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6432877-018f-42d2-8e5e-a304de9fcb2c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.171630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6432877-018f-42d2-8e5e-a304de9fcb2c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.171918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6432877-018f-42d2-8e5e-a304de9fcb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.172516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58fda9-cb41-4ac1-be70-6ad147122837 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:27.194214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b6432877-018f-42d2-8e5e-a304de9fcb2c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:27.195786 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b6432877-018f-42d2-8e5e-a304de9fcb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:27.196562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 20/39] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jul 12 14:19:26 2022] POST /identity/v3/roles => generated 219 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:27.197603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58fda9-cb41-4ac1-be70-6ad147122837 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:27.333623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58fda9-cb41-4ac1-be70-6ad147122837 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:27.381891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef1c9-a104-449b-bae8-de803febe055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:27.382242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef1c9-a104-449b-bae8-de803febe055 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.382536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef1c9-a104-449b-bae8-de803febe055 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.382862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef1c9-a104-449b-bae8-de803febe055 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.383606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef1c9-a104-449b-bae8-de803febe055 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:27.385145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef1c9-a104-449b-bae8-de803febe055 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:27.412799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 20/40] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:27.426931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 21/41] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:19:27 2022] POST /identity/v3/projects => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:27.443838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1fec1-bc62-4e1a-8722-8dc29ccd69c1 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.444145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1fec1-bc62-4e1a-8722-8dc29ccd69c1 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.444435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1fec1-bc62-4e1a-8722-8dc29ccd69c1 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.445005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef1c9-a104-449b-bae8-de803febe055 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:27.446007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 21/42] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:27.451676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bd175-0285-4455-90f8-c7ac1e9b5754 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.451970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bd175-0285-4455-90f8-c7ac1e9b5754 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.452268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bd175-0285-4455-90f8-c7ac1e9b5754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.456786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:27.484687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5f3bd175-0285-4455-90f8-c7ac1e9b5754 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:27.487150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5f3bd175-0285-4455-90f8-c7ac1e9b5754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:27.579688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 22/43] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:27.604492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef1c9-a104-449b-bae8-de803febe055 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:27.612710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bd175-0285-4455-90f8-c7ac1e9b5754 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:27.647703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f1ad-123d-4fea-adb9-2d4ed924a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:27.648387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f1ad-123d-4fea-adb9-2d4ed924a7b4 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.648684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f1ad-123d-4fea-adb9-2d4ed924a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.648964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f1ad-123d-4fea-adb9-2d4ed924a7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.649742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0f1ad-123d-4fea-adb9-2d4ed924a7b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:27.651696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0f1ad-123d-4fea-adb9-2d4ed924a7b4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:27.654982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:27.670598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 22/44] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jul 12 14:19:27 2022] POST /identity/v3/roles => generated 223 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:27.748683 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bd175-0285-4455-90f8-c7ac1e9b5754 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:27.786934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f2e1b-48dc-4e4f-909a-7ada6896c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:27.787783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2e1b-48dc-4e4f-909a-7ada6896c343 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.788077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2e1b-48dc-4e4f-909a-7ada6896c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.788361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2e1b-48dc-4e4f-909a-7ada6896c343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.789617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2e1b-48dc-4e4f-909a-7ada6896c343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:27.791158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2e1b-48dc-4e4f-909a-7ada6896c343 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:27.793094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 23/45] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:27.798605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f1ad-123d-4fea-adb9-2d4ed924a7b4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:27.871087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:27.908994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f1ad-123d-4fea-adb9-2d4ed924a7b4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:27.940975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500faf9-9fb0-4985-8387-269f1440a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:27.941719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500faf9-9fb0-4985-8387-269f1440a144 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:27.942031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500faf9-9fb0-4985-8387-269f1440a144 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:27.942317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500faf9-9fb0-4985-8387-269f1440a144 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:27.943071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500faf9-9fb0-4985-8387-269f1440a144 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:27.944532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500faf9-9fb0-4985-8387-269f1440a144 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:27.972974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 23/46] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:19:27 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:29.205045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48e68c-d284-43da-a5a1-274830936136 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:29.205551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48e68c-d284-43da-a5a1-274830936136 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:29.205729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48e68c-d284-43da-a5a1-274830936136 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:29.207147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 24/47] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:29.212425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1bd2-75f1-45d4-a4cb-389d187b9fa8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:29.212797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1bd2-75f1-45d4-a4cb-389d187b9fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:29.213126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1bd2-75f1-45d4-a4cb-389d187b9fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:29.334240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cb8f1bd2-75f1-45d4-a4cb-389d187b9fa8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:29.335715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cb8f1bd2-75f1-45d4-a4cb-389d187b9fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:29.400538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 24/48] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:29.424013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48e68c-d284-43da-a5a1-274830936136 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:29.523966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48e68c-d284-43da-a5a1-274830936136 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:29.526500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:29.557160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cab7c3-6303-4e9b-9c9d-15bbd224503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:29.557957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cab7c3-6303-4e9b-9c9d-15bbd224503d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:29.558244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cab7c3-6303-4e9b-9c9d-15bbd224503d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:29.558524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cab7c3-6303-4e9b-9c9d-15bbd224503d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:29.568875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cab7c3-6303-4e9b-9c9d-15bbd224503d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-50cab7c3-6303-4e9b-9c9d-15bbd224503d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:29.577016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:29.577826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:29.578830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 25/49] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:29.583980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f1bd2-75f1-45d4-a4cb-389d187b9fa8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:29.631875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:29.682990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f1bd2-75f1-45d4-a4cb-389d187b9fa8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:29.716150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:29.716846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:29.717158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:29.717441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:29.718194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:29.718506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:29.719955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:29.731344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 25/50] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:29.736840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cab7c3-6303-4e9b-9c9d-15bbd224503d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:29.834534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cab7c3-6303-4e9b-9c9d-15bbd224503d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:29.867320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319f775-79bd-41ce-ba3b-321e368d0416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:29.868207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319f775-79bd-41ce-ba3b-321e368d0416 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:29.868495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319f775-79bd-41ce-ba3b-321e368d0416 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:29.868776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319f775-79bd-41ce-ba3b-321e368d0416 None admin] PATH_INFO: `/v3/users/117ad82133d0435087c48fd76e0b6541` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:29.869957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319f775-79bd-41ce-ba3b-321e368d0416 None admin] RBAC: Authorizing `identity:get_user(user_id=117ad82133d0435087c48fd76e0b6541)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:29.871451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319f775-79bd-41ce-ba3b-321e368d0416 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:29.873062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 26/51] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:29 2022] GET /identity/v3/users/117ad82133d0435087c48fd76e0b6541 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:29.879005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:29.976509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d9522-d5aa-45dd-9679-af1ef962e711 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:29.987969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:30.006476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd3eaf-3346-4a47-8f49-102534d14044 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:30.006790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd3eaf-3346-4a47-8f49-102534d14044 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:30.007103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd3eaf-3346-4a47-8f49-102534d14044 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:30.008606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 27/52] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:19:30.012776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3628c-8836-4371-b695-e503826e533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:30.013135 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa0486-5a0d-451c-a6f5-ea5c73ba90cb None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:30.013433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa0486-5a0d-451c-a6f5-ea5c73ba90cb None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:30.013584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3628c-8836-4371-b695-e503826e533b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:30.013722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa0486-5a0d-451c-a6f5-ea5c73ba90cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:30.013876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3628c-8836-4371-b695-e503826e533b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:30.014160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3628c-8836-4371-b695-e503826e533b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:30.015410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3628c-8836-4371-b695-e503826e533b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:30.016855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3628c-8836-4371-b695-e503826e533b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:30.018460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:30.023909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3628c-8836-4371-b695-e503826e533b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:30.030502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7dfa0486-5a0d-451c-a6f5-ea5c73ba90cb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:30.031753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7dfa0486-5a0d-451c-a6f5-ea5c73ba90cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:30.059070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:30.101424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 28/54] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:30.124972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa0486-5a0d-451c-a6f5-ea5c73ba90cb None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:30.125773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3628c-8836-4371-b695-e503826e533b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:30.158481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:30.159184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:30.159485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:30.159774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:30.160615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.domain.id=default, user.id=117ad82133d0435087c48fd76e0b6541) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:30.160937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:30.162404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:30.170754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1322 bytes} [Tue Jul 12 14:19:30 2022] GET /identity/v3/role_assignments?user.id=117ad82133d0435087c48fd76e0b6541&scope.domain.id=default&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:30.225019 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa0486-5a0d-451c-a6f5-ea5c73ba90cb None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:30.260890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af3c2-5b52-4247-9d0d-e36cc5de73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:30.261635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af3c2-5b52-4247-9d0d-e36cc5de73b8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:30.261930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af3c2-5b52-4247-9d0d-e36cc5de73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:30.262215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af3c2-5b52-4247-9d0d-e36cc5de73b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:30.263451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af3c2-5b52-4247-9d0d-e36cc5de73b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:30.264926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af3c2-5b52-4247-9d0d-e36cc5de73b8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:30.266600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 29/56] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:30.272557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:30.318850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:30.380559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453c7a-509b-42bf-b5e1-950c5a00b3c5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:30.413702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758e976-d93a-4602-8a3e-c348abd980be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:30.414375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758e976-d93a-4602-8a3e-c348abd980be None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:30.414672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758e976-d93a-4602-8a3e-c348abd980be None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:30.414996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758e976-d93a-4602-8a3e-c348abd980be None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:30.415716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758e976-d93a-4602-8a3e-c348abd980be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:30.417163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758e976-d93a-4602-8a3e-c348abd980be None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:30.441387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 28/57] 10.222.0.72 () {60 vars in 1140 bytes} [Tue Jul 12 14:19:30 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:32.446727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43c20-fe5c-468d-8ce6-fb8b407e4fab None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:32.447243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43c20-fe5c-468d-8ce6-fb8b407e4fab None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:32.447322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43c20-fe5c-468d-8ce6-fb8b407e4fab None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:32.448694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 30/58] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:32.454300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2aca1-cfba-418e-95ba-399a28429464 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:32.454691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2aca1-cfba-418e-95ba-399a28429464 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:32.454959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2aca1-cfba-418e-95ba-399a28429464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:32.471791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-24a2aca1-cfba-418e-95ba-399a28429464 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:32.473033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-24a2aca1-cfba-418e-95ba-399a28429464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:32.536941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 29/59] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:32.560140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe43c20-fe5c-468d-8ce6-fb8b407e4fab None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:32.590093 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:32.659147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe43c20-fe5c-468d-8ce6-fb8b407e4fab None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:32.692480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097bc40-24b5-47b0-bb94-8815bc0bce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:32.693272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bc40-24b5-47b0-bb94-8815bc0bce71 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:32.693559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bc40-24b5-47b0-bb94-8815bc0bce71 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:32.693840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bc40-24b5-47b0-bb94-8815bc0bce71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:32.695024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097bc40-24b5-47b0-bb94-8815bc0bce71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:32.696483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097bc40-24b5-47b0-bb94-8815bc0bce71 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:32.698141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 31/60] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:32.704117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2aca1-cfba-418e-95ba-399a28429464 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:32.727818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:32.801455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2aca1-cfba-418e-95ba-399a28429464 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:32.836852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ddba7-e630-4ced-958f-536d16595826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:32.837534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddba7-e630-4ced-958f-536d16595826 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:32.837827 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddba7-e630-4ced-958f-536d16595826 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:32.838107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddba7-e630-4ced-958f-536d16595826 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:32.838866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ddba7-e630-4ced-958f-536d16595826 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:32.840330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ddba7-e630-4ced-958f-536d16595826 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:32.865120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 30/61] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:19:32 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:35.905271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f41dd4-9604-47fe-ad2b-453c559a39c0 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:35.906165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f41dd4-9604-47fe-ad2b-453c559a39c0 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:35.906631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f41dd4-9604-47fe-ad2b-453c559a39c0 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:35.908164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 32/62] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:35.913717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6103e-0eda-41b1-87a6-dff3ea7221a7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:35.914460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6103e-0eda-41b1-87a6-dff3ea7221a7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:35.914911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6103e-0eda-41b1-87a6-dff3ea7221a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:35.934662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-24e6103e-0eda-41b1-87a6-dff3ea7221a7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:35.936197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-24e6103e-0eda-41b1-87a6-dff3ea7221a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:36.030298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 31/63] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:36.082730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f41dd4-9604-47fe-ad2b-453c559a39c0 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:36.097439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880b09e-6a54-4558-aa07-e657ed713f8f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.098173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880b09e-6a54-4558-aa07-e657ed713f8f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.099879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880b09e-6a54-4558-aa07-e657ed713f8f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.102383 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 32/64] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:36.107092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5987-f105-4cff-a75e-c6e6abbcde72 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.107565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5987-f105-4cff-a75e-c6e6abbcde72 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.108515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5987-f105-4cff-a75e-c6e6abbcde72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.133271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d29e5987-f105-4cff-a75e-c6e6abbcde72 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:36.134475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d29e5987-f105-4cff-a75e-c6e6abbcde72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:36.151905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:36.241021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:36.245618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f41dd4-9604-47fe-ad2b-453c559a39c0 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:36.267263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 33/65] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:36.272508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cad40-2a35-4b2c-ac27-2d67d823ba58 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.273078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cad40-2a35-4b2c-ac27-2d67d823ba58 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.273367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cad40-2a35-4b2c-ac27-2d67d823ba58 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.279187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 34/66] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:36.283887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c24a7-35b6-450e-8eb8-60da01cfa074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:36.284920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c24a7-35b6-450e-8eb8-60da01cfa074 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.285406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c24a7-35b6-450e-8eb8-60da01cfa074 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.285879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c24a7-35b6-450e-8eb8-60da01cfa074 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.292443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39b39-ec03-4c15-bd5c-c484bedb7382 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.293599 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39b39-ec03-4c15-bd5c-c484bedb7382 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.294253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39b39-ec03-4c15-bd5c-c484bedb7382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.300610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c24a7-35b6-450e-8eb8-60da01cfa074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-b13c24a7-35b6-450e-8eb8-60da01cfa074 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:36.310924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:36.312309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:36.313118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:36.314522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-01b39b39-ec03-4c15-bd5c-c484bedb7382 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:36.315757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-01b39b39-ec03-4c15-bd5c-c484bedb7382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:36.316001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 33/67] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:36.316978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c24a7-35b6-450e-8eb8-60da01cfa074 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:36.395777 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 35/68] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:36.396938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b39b39-ec03-4c15-bd5c-c484bedb7382 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:36.454819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c24a7-35b6-450e-8eb8-60da01cfa074 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:36.472343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:36.494353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85495-07d5-461e-bdc4-c2a387ab4a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:36.495449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85495-07d5-461e-bdc4-c2a387ab4a60 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.495927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85495-07d5-461e-bdc4-c2a387ab4a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.496381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85495-07d5-461e-bdc4-c2a387ab4a60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.507120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b39b39-ec03-4c15-bd5c-c484bedb7382 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:36.507813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede85495-07d5-461e-bdc4-c2a387ab4a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-ede85495-07d5-461e-bdc4-c2a387ab4a60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:36.516278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:36.517125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:36.517853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:36.525171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:36.526348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85495-07d5-461e-bdc4-c2a387ab4a60 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:36.544342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:36.545030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.545318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.546266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.547063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:36.547377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:36.548783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:36.550097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:36.557895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 36/70] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:36.562632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:36.640851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85495-07d5-461e-bdc4-c2a387ab4a60 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:36.670317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e73a72-34d7-458e-9677-ef1351514e95 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:36.673979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d05d99-2604-4680-8207-61097166b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:36.674824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05d99-2604-4680-8207-61097166b407 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.675125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05d99-2604-4680-8207-61097166b407 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.675408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05d99-2604-4680-8207-61097166b407 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.685215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d05d99-2604-4680-8207-61097166b407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-c6d05d99-2604-4680-8207-61097166b407 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:36.693413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:36.694417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:36.695203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 35/71] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:19:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:36.696700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0724f-9c53-4a88-a3be-36b2a4b615fd None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.696994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0724f-9c53-4a88-a3be-36b2a4b615fd None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.697276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0724f-9c53-4a88-a3be-36b2a4b615fd None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.698564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 36/72] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:36.699506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0724f-9c53-4a88-a3be-36b2a4b615fd None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:36.703883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:36.709257 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583068aa-52aa-4340-810d-dc8b4f66db2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:36.709933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583068aa-52aa-4340-810d-dc8b4f66db2f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.710224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583068aa-52aa-4340-810d-dc8b4f66db2f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.710505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583068aa-52aa-4340-810d-dc8b4f66db2f None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.711312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583068aa-52aa-4340-810d-dc8b4f66db2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:36.711622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583068aa-52aa-4340-810d-dc8b4f66db2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:36.713013 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583068aa-52aa-4340-810d-dc8b4f66db2f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:36.723523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 37/73] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:36.724660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534d555-4631-4141-a8b3-5077ca15d33a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.724950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534d555-4631-4141-a8b3-5077ca15d33a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.725228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534d555-4631-4141-a8b3-5077ca15d33a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.726454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 38/74] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:36.727190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534d555-4631-4141-a8b3-5077ca15d33a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:36.782549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:36.804865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0724f-9c53-4a88-a3be-36b2a4b615fd None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:36.828260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534d555-4631-4141-a8b3-5077ca15d33a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:36.838919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de0571-119a-4827-a6cc-00d28e5d1f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:36.839798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de0571-119a-4827-a6cc-00d28e5d1f71 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.840086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de0571-119a-4827-a6cc-00d28e5d1f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.840367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de0571-119a-4827-a6cc-00d28e5d1f71 None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.853880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de0571-119a-4827-a6cc-00d28e5d1f71 None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:36.855674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de0571-119a-4827-a6cc-00d28e5d1f71 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:36.857498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 37/75] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:36 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:36.859169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ed35-8578-48d9-8290-314617675d97 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.859463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ed35-8578-48d9-8290-314617675d97 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.859746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ed35-8578-48d9-8290-314617675d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.862371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:36.862948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.863234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.863520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.864271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:36.864583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:36.865968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:36.874623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 39/76] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:19:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:36.875263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:36.875756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-fd54ed35-8578-48d9-8290-314617675d97 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:36.876940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fd54ed35-8578-48d9-8290-314617675d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:36.930333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:36.942223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 38/77] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:36.943412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285982f-d9a1-48e6-8749-0388d2dda0cb None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:36.943710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285982f-d9a1-48e6-8749-0388d2dda0cb None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:36.943993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285982f-d9a1-48e6-8749-0388d2dda0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:36.959359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a285982f-d9a1-48e6-8749-0388d2dda0cb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:36.960532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a285982f-d9a1-48e6-8749-0388d2dda0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:36.976145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ffc80-c242-4fb9-acbb-54449ef87ec0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.009943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5193beb-9307-4230-96cb-ee9a68994471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.010850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5193beb-9307-4230-96cb-ee9a68994471 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.011139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5193beb-9307-4230-96cb-ee9a68994471 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.011416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5193beb-9307-4230-96cb-ee9a68994471 None admin] PATH_INFO: `/v3/users/117ad82133d0435087c48fd76e0b6541` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.012631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5193beb-9307-4230-96cb-ee9a68994471 None admin] RBAC: Authorizing `identity:get_user(user_id=117ad82133d0435087c48fd76e0b6541)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.014108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5193beb-9307-4230-96cb-ee9a68994471 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.015773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 40/78] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:36 2022] GET /identity/v3/users/117ad82133d0435087c48fd76e0b6541 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:37.016527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5193beb-9307-4230-96cb-ee9a68994471 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.023546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.032806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 39/79] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:37.033592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285982f-d9a1-48e6-8749-0388d2dda0cb None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.119369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5193beb-9307-4230-96cb-ee9a68994471 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.136382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285982f-d9a1-48e6-8749-0388d2dda0cb None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.142087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.154277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958d8e2-c03e-43ee-84af-f59975a4176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.155489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d8e2-c03e-43ee-84af-f59975a4176e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.155788 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d8e2-c03e-43ee-84af-f59975a4176e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.156079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958d8e2-c03e-43ee-84af-f59975a4176e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.169674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ec96c-ea71-4122-8197-bdd1a2f18adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.170601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ec96c-ea71-4122-8197-bdd1a2f18adc None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.171411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ec96c-ea71-4122-8197-bdd1a2f18adc None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.171691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ec96c-ea71-4122-8197-bdd1a2f18adc None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.172889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ec96c-ea71-4122-8197-bdd1a2f18adc None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.174345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ec96c-ea71-4122-8197-bdd1a2f18adc None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.175992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 40/80] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:37.176747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ec96c-ea71-4122-8197-bdd1a2f18adc None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.226294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958d8e2-c03e-43ee-84af-f59975a4176e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.227825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958d8e2-c03e-43ee-84af-f59975a4176e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.238523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.274975 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ec96c-ea71-4122-8197-bdd1a2f18adc None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.309636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8fa63-cbd3-4de9-a3cb-d8c82da28651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.310363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8fa63-cbd3-4de9-a3cb-d8c82da28651 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.310655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8fa63-cbd3-4de9-a3cb-d8c82da28651 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.310984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8fa63-cbd3-4de9-a3cb-d8c82da28651 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.321154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8fa63-cbd3-4de9-a3cb-d8c82da28651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:37.325486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 41/81] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:37.326326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958d8e2-c03e-43ee-84af-f59975a4176e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-fbe8fa63-cbd3-4de9-a3cb-d8c82da28651 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:37.329360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:37.330156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:37.330920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 41/82] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:37.331562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8fa63-cbd3-4de9-a3cb-d8c82da28651 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.355157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.427858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958d8e2-c03e-43ee-84af-f59975a4176e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.428316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8fa63-cbd3-4de9-a3cb-d8c82da28651 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.450430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.461647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40938ad0-63e8-4887-8eb0-ffac73122ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.461887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53932fcc-2036-4270-a97d-099d8b02db7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.462443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40938ad0-63e8-4887-8eb0-ffac73122ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.462554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53932fcc-2036-4270-a97d-099d8b02db7e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.462734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40938ad0-63e8-4887-8eb0-ffac73122ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.462875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53932fcc-2036-4270-a97d-099d8b02db7e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.463042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40938ad0-63e8-4887-8eb0-ffac73122ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.463165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53932fcc-2036-4270-a97d-099d8b02db7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.464207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40938ad0-63e8-4887-8eb0-ffac73122ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.465662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40938ad0-63e8-4887-8eb0-ffac73122ec1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.467293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 42/83] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:37.468604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40938ad0-63e8-4887-8eb0-ffac73122ec1 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.531452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53932fcc-2036-4270-a97d-099d8b02db7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.532923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53932fcc-2036-4270-a97d-099d8b02db7e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.556035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.564875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40938ad0-63e8-4887-8eb0-ffac73122ec1 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.599053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59fc52-9638-430a-a1f5-e3b967b07761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.599715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fc52-9638-430a-a1f5-e3b967b07761 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.600010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fc52-9638-430a-a1f5-e3b967b07761 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.600303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fc52-9638-430a-a1f5-e3b967b07761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.629153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 42/84] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:37.630063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53932fcc-2036-4270-a97d-099d8b02db7e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.661186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.671499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59fc52-9638-430a-a1f5-e3b967b07761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.672995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59fc52-9638-430a-a1f5-e3b967b07761 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.727457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53932fcc-2036-4270-a97d-099d8b02db7e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.752161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.763974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842cea-d9ed-4055-80be-c4e179c223b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.765391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842cea-d9ed-4055-80be-c4e179c223b5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.765684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842cea-d9ed-4055-80be-c4e179c223b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.765966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842cea-d9ed-4055-80be-c4e179c223b5 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.767210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4842cea-d9ed-4055-80be-c4e179c223b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.768716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4842cea-d9ed-4055-80be-c4e179c223b5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.770436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 43/85] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:37.771233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842cea-d9ed-4055-80be-c4e179c223b5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.775698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 43/86] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:37.776523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59fc52-9638-430a-a1f5-e3b967b07761 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.863941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:37.870285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842cea-d9ed-4055-80be-c4e179c223b5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.873290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59fc52-9638-430a-a1f5-e3b967b07761 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:37.904437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.905146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.905443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.905732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.906490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:37.906830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.908228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.910596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342902-2e08-4c05-b891-e4e0a9bf1c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:37.911305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342902-2e08-4c05-b891-e4e0a9bf1c21 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:37.911594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342902-2e08-4c05-b891-e4e0a9bf1c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:37.911874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342902-2e08-4c05-b891-e4e0a9bf1c21 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:37.912592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3342902-2e08-4c05-b891-e4e0a9bf1c21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:37.914071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3342902-2e08-4c05-b891-e4e0a9bf1c21 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:37.916239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 44/87] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:37.917034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.939408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 44/88] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:19:37 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:37.940235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342902-2e08-4c05-b891-e4e0a9bf1c21 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:37.978372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:38.032975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f321e8-133c-49a1-98e7-c65fc0c8c65a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:38.055934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342902-2e08-4c05-b891-e4e0a9bf1c21 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:38.076584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ae978-d033-4f91-a994-f9fcffc323f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:38.078103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae978-d033-4f91-a994-f9fcffc323f2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:38.078399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae978-d033-4f91-a994-f9fcffc323f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:38.078692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae978-d033-4f91-a994-f9fcffc323f2 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:38.080001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ae978-d033-4f91-a994-f9fcffc323f2 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:38.081486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ae978-d033-4f91-a994-f9fcffc323f2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:38.088193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 45/89] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:38.088193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ae978-d033-4f91-a994-f9fcffc323f2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:38.107758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:38.109589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:38.110066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:38.110562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:38.111448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] RBAC: Adding query filter params (role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=d0340b60166b4c069c60576799d26a32, user.id=4d27a9d64e924ced8ab73b7b339ccdcb) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:38.111773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:38.113262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:38.119145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 45/90] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:37 2022] GET /identity/v3/role_assignments?user.id=4d27a9d64e924ced8ab73b7b339ccdcb&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:38.119963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:38.147258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:38.224365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ae978-d033-4f91-a994-f9fcffc323f2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:38.257764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:38.274363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a74c6-aa13-4052-a672-0c046e5ac529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:38.275589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a74c6-aa13-4052-a672-0c046e5ac529 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:38.276062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a74c6-aa13-4052-a672-0c046e5ac529 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:38.276555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a74c6-aa13-4052-a672-0c046e5ac529 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:38.277072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2581e-ef2d-4c03-954c-f40d51b5ef69 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:38.279202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a74c6-aa13-4052-a672-0c046e5ac529 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:38.281369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a74c6-aa13-4052-a672-0c046e5ac529 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:38.282820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 46/91] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:38 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:38.283634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a74c6-aa13-4052-a672-0c046e5ac529 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:38.323338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37330c38-01b1-41dc-a0fe-d08f12dd6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:38.324403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330c38-01b1-41dc-a0fe-d08f12dd6244 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:38.324793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330c38-01b1-41dc-a0fe-d08f12dd6244 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:38.325081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330c38-01b1-41dc-a0fe-d08f12dd6244 None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:38.327268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37330c38-01b1-41dc-a0fe-d08f12dd6244 None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:38.328764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37330c38-01b1-41dc-a0fe-d08f12dd6244 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:38.330588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 46/92] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:38 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:38.331351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37330c38-01b1-41dc-a0fe-d08f12dd6244 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:38.424937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:38.431211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a74c6-aa13-4052-a672-0c046e5ac529 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:38.456133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37330c38-01b1-41dc-a0fe-d08f12dd6244 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:38.473646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:38.474325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:38.474662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:38.474981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:38.475831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d0340b60166b4c069c60576799d26a32, user.id=117ad82133d0435087c48fd76e0b6541) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:38.476151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:38.477602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:38.484193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 47/93] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:38 2022] GET /identity/v3/role_assignments?user.id=117ad82133d0435087c48fd76e0b6541&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:38.489709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:38.502409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:38.504066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:38.504554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:38.505026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:38.506243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] RBAC: Adding query filter params (role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=d0340b60166b4c069c60576799d26a32, user.id=4d27a9d64e924ced8ab73b7b339ccdcb) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:38.506752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:38.509121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:38.517090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 47/94] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:38 2022] GET /identity/v3/role_assignments?user.id=4d27a9d64e924ced8ab73b7b339ccdcb&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:38.612802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:38.673402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0917b12-44de-4d14-b8f4-c3ad235c06bb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:38.723087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdb4c6-e37d-4709-bee2-352a3c6c159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:38.723704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdb4c6-e37d-4709-bee2-352a3c6c159d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:38.723988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdb4c6-e37d-4709-bee2-352a3c6c159d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:38.724271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdb4c6-e37d-4709-bee2-352a3c6c159d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:38.833127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdb4c6-e37d-4709-bee2-352a3c6c159d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:38.834641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdb4c6-e37d-4709-bee2-352a3c6c159d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:38.893416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:38.955784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 48/95] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:38.962350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:39.101919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eaa63-8c2f-4c73-a192-d312b591d0ea None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:39.137654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d12221-90d8-4975-b202-814383a1d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:39.138538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12221-90d8-4975-b202-814383a1d53d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:39.138892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12221-90d8-4975-b202-814383a1d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:39.139221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12221-90d8-4975-b202-814383a1d53d None admin] PATH_INFO: `/v3/projects/2ea7d70a61b34863a87e467e31674f88` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:39.141004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d12221-90d8-4975-b202-814383a1d53d None admin] RBAC: Authorizing `identity:get_project(project_id=2ea7d70a61b34863a87e467e31674f88)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:39.142496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d12221-90d8-4975-b202-814383a1d53d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:39.144246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 48/96] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:38 2022] GET /identity/v3/projects/2ea7d70a61b34863a87e467e31674f88 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:39.150053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdb4c6-e37d-4709-bee2-352a3c6c159d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:39.255907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdb4c6-e37d-4709-bee2-352a3c6c159d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:39.292704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e7843-7f32-4361-9763-5f9b293fea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:39.293381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e7843-7f32-4361-9763-5f9b293fea61 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:39.293678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e7843-7f32-4361-9763-5f9b293fea61 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:39.293967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e7843-7f32-4361-9763-5f9b293fea61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:39.294851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e7843-7f32-4361-9763-5f9b293fea61 None admin] RBAC: Adding query filter params (role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=2ea7d70a61b34863a87e467e31674f88, user.id=4d27a9d64e924ced8ab73b7b339ccdcb) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:39.295181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e7843-7f32-4361-9763-5f9b293fea61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:39.296677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e7843-7f32-4361-9763-5f9b293fea61 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:39.302478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 49/97] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:39 2022] GET /identity/v3/role_assignments?user.id=4d27a9d64e924ced8ab73b7b339ccdcb&scope.project.id=2ea7d70a61b34863a87e467e31674f88&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:40.741302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cb91-413e-4862-9f64-4da60e7fdb2f None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:40.741843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cb91-413e-4862-9f64-4da60e7fdb2f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:40.741919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cb91-413e-4862-9f64-4da60e7fdb2f None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:40.743300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 49/98] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:40.749976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08250c-26f3-4b06-9135-aaffcceda6d6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:40.750390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08250c-26f3-4b06-9135-aaffcceda6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:40.750552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08250c-26f3-4b06-9135-aaffcceda6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:40.771738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ec08250c-26f3-4b06-9135-aaffcceda6d6 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:40.772972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ec08250c-26f3-4b06-9135-aaffcceda6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:40.789346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:40.847451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 50/99] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:40.869370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cb91-413e-4862-9f64-4da60e7fdb2f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:40.885955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:40.979400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cb91-413e-4862-9f64-4da60e7fdb2f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:41.016287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8a433-b716-42a0-be35-d5abf9decf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:41.017025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a433-b716-42a0-be35-d5abf9decf63 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.017322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a433-b716-42a0-be35-d5abf9decf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.017608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a433-b716-42a0-be35-d5abf9decf63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.028549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8a433-b716-42a0-be35-d5abf9decf63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-12f8a433-b716-42a0-be35-d5abf9decf63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:41.036452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:41.037297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:41.038766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 50/100] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:41.045696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08250c-26f3-4b06-9135-aaffcceda6d6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:41.140746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca6f1-cbd4-4b00-a495-4b8de3797db8 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.141039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca6f1-cbd4-4b00-a495-4b8de3797db8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.141559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca6f1-cbd4-4b00-a495-4b8de3797db8 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.143197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 51/101] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:19:41.147941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08250c-26f3-4b06-9135-aaffcceda6d6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:41.148547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211df41-4742-4fa0-913b-ef8df326509e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.149058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211df41-4742-4fa0-913b-ef8df326509e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.149634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211df41-4742-4fa0-913b-ef8df326509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.167777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-c211df41-4742-4fa0-913b-ef8df326509e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:41.169437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c211df41-4742-4fa0-913b-ef8df326509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:41.194538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:41.195325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.196100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.196395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.197317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:41.197784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:41.199481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:41.211537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 51/102] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:41.216971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:41.230125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:41.252811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 52/103] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:41.277287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211df41-4742-4fa0-913b-ef8df326509e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:41.279793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:41.326961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b63ae-50a0-4b57-b085-2cdb34f08c17 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:41.364195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81290a04-ec53-40ba-bde3-5e6739e05564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:41.365345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290a04-ec53-40ba-bde3-5e6739e05564 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.365784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290a04-ec53-40ba-bde3-5e6739e05564 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.366213 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290a04-ec53-40ba-bde3-5e6739e05564 None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.367613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290a04-ec53-40ba-bde3-5e6739e05564 None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:41.369217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290a04-ec53-40ba-bde3-5e6739e05564 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:41.371073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 52/104] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:41 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:41.372488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4121c4-13b3-43d7-a71a-fc32af78e610 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.372960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4121c4-13b3-43d7-a71a-fc32af78e610 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.373432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4121c4-13b3-43d7-a71a-fc32af78e610 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.379755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 53/105] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:41.380721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4121c4-13b3-43d7-a71a-fc32af78e610 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:41.390760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211df41-4742-4fa0-913b-ef8df326509e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:41.428165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4aa6-e075-4e95-8a8c-1c4153c637d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:41.429246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4aa6-e075-4e95-8a8c-1c4153c637d1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.429681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4aa6-e075-4e95-8a8c-1c4153c637d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.430173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4aa6-e075-4e95-8a8c-1c4153c637d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.431742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d4aa6-e075-4e95-8a8c-1c4153c637d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:41.433466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d4aa6-e075-4e95-8a8c-1c4153c637d1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:41.435680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 53/106] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:41.441925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78cde-b176-44a0-af9e-a4ab16ae7187 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.442657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78cde-b176-44a0-af9e-a4ab16ae7187 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.443146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78cde-b176-44a0-af9e-a4ab16ae7187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.460667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-55e78cde-b176-44a0-af9e-a4ab16ae7187 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:41.462189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-55e78cde-b176-44a0-af9e-a4ab16ae7187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:41.467614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:41.492733 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4121c4-13b3-43d7-a71a-fc32af78e610 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:41.528990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d22bcf-b6ca-4125-8f6b-f12f643bd181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:41.529888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22bcf-b6ca-4125-8f6b-f12f643bd181 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.530797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22bcf-b6ca-4125-8f6b-f12f643bd181 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.531170 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22bcf-b6ca-4125-8f6b-f12f643bd181 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.532535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d22bcf-b6ca-4125-8f6b-f12f643bd181 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:41.534097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d22bcf-b6ca-4125-8f6b-f12f643bd181 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:41.535546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:41.536176 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 54/107] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:41 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:41.536835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d22bcf-b6ca-4125-8f6b-f12f643bd181 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:41.542687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 54/108] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:41.545101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78cde-b176-44a0-af9e-a4ab16ae7187 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:41.648234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d22bcf-b6ca-4125-8f6b-f12f643bd181 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:41.651244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78cde-b176-44a0-af9e-a4ab16ae7187 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:41.684849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ad870-8723-467a-ba80-b4ef3bca0969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:41.685629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad870-8723-467a-ba80-b4ef3bca0969 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.686006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad870-8723-467a-ba80-b4ef3bca0969 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.686365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad870-8723-467a-ba80-b4ef3bca0969 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.687386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ad870-8723-467a-ba80-b4ef3bca0969 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:41.688962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ad870-8723-467a-ba80-b4ef3bca0969 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:41.689664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d597489-3def-48a2-be84-fed0b2113e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:41.690694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597489-3def-48a2-be84-fed0b2113e1c None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.691109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597489-3def-48a2-be84-fed0b2113e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.691401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d597489-3def-48a2-be84-fed0b2113e1c None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32/users/4d27a9d64e924ced8ab73b7b339ccdcb/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.693544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d597489-3def-48a2-be84-fed0b2113e1c None admin] RBAC: Authorizing `identity:create_grant(project_id=d0340b60166b4c069c60576799d26a32, user_id=4d27a9d64e924ced8ab73b7b339ccdcb, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:41.695095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d597489-3def-48a2-be84-fed0b2113e1c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:41.710552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:41.713351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 55/109] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:19:41 2022] PUT /identity/v3/projects/d0340b60166b4c069c60576799d26a32/users/4d27a9d64e924ced8ab73b7b339ccdcb/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:19:41.714606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d597489-3def-48a2-be84-fed0b2113e1c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:41.730370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 55/110] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:19:41 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:41.738055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324b7d-7095-4624-8e9b-eafd6b60f1d1 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.738055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324b7d-7095-4624-8e9b-eafd6b60f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.738055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324b7d-7095-4624-8e9b-eafd6b60f1d1 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.738055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 56/111] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:41.740702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ddee-b777-477e-93b5-8af60f09d05c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:41.743414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ddee-b777-477e-93b5-8af60f09d05c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:41.743715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ddee-b777-477e-93b5-8af60f09d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:41.776261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c1a5ddee-b777-477e-93b5-8af60f09d05c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:41.778058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c1a5ddee-b777-477e-93b5-8af60f09d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:41.873272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:41.912995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 57/112] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:41.947698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5ddee-b777-477e-93b5-8af60f09d05c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:41.962754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d597489-3def-48a2-be84-fed0b2113e1c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:42.027862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad2e90-0262-4929-a873-1715170d3292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:42.029151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad2e90-0262-4929-a873-1715170d3292 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.029151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad2e90-0262-4929-a873-1715170d3292 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.029436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad2e90-0262-4929-a873-1715170d3292 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.052599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad2e90-0262-4929-a873-1715170d3292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d4ad2e90-0262-4929-a873-1715170d3292 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:42.068613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:42.069434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:19:42.070167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:42.073253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 56/113] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:42.080436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad2e90-0262-4929-a873-1715170d3292 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:42.144836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5ddee-b777-477e-93b5-8af60f09d05c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:42.193176 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fc29e-d83d-4bb8-b336-b409ece66bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:42.194557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc29e-d83d-4bb8-b336-b409ece66bee None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.194941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc29e-d83d-4bb8-b336-b409ece66bee None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.195236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc29e-d83d-4bb8-b336-b409ece66bee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.199157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:42.211887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fc29e-d83d-4bb8-b336-b409ece66bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:42.220987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad2e90-0262-4929-a873-1715170d3292 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b72fc29e-d83d-4bb8-b336-b409ece66bee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:42.223258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:42.224083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:42.224814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 58/114] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:19:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:19:42.225904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca72e95-1652-4786-acb9-38acf275aed4 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.226143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca72e95-1652-4786-acb9-38acf275aed4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.226465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca72e95-1652-4786-acb9-38acf275aed4 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.230794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 59/115] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:42.233541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca72e95-1652-4786-acb9-38acf275aed4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:42.261658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:42.288172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044de82-8124-4db1-af56-02c69d8eb220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:42.289332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044de82-8124-4db1-af56-02c69d8eb220 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.289830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044de82-8124-4db1-af56-02c69d8eb220 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.290415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044de82-8124-4db1-af56-02c69d8eb220 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.291422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044de82-8124-4db1-af56-02c69d8eb220 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:42.291940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044de82-8124-4db1-af56-02c69d8eb220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:42.293768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044de82-8124-4db1-af56-02c69d8eb220 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:42.316923 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 57/116] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:42.318520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7865e4-4973-492a-933f-ec6bd82dd7d7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.319137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7865e4-4973-492a-933f-ec6bd82dd7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.319717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7865e4-4973-492a-933f-ec6bd82dd7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.345632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-3e7865e4-4973-492a-933f-ec6bd82dd7d7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:42.351380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3e7865e4-4973-492a-933f-ec6bd82dd7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:42.355089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca72e95-1652-4786-acb9-38acf275aed4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:42.397618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:42.398320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.398668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.398992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.400237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:42.400561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:42.402428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:42.412568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 60/117] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:19:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:42.413552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:42.479225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:42.487075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 58/118] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:42.488297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7865e4-4973-492a-933f-ec6bd82dd7d7 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:42.554280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d432ef-0d22-4b34-8e95-69643856704b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:42.601504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edae822-4ba6-44ac-9ff3-25836abb993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:42.602396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae822-4ba6-44ac-9ff3-25836abb993d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.602686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae822-4ba6-44ac-9ff3-25836abb993d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.602992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae822-4ba6-44ac-9ff3-25836abb993d None admin] PATH_INFO: `/v3/users/3a0e6e305ad64223ab9e1663e798a4a9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.628020 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae822-4ba6-44ac-9ff3-25836abb993d None admin] RBAC: Authorizing `identity:get_user(user_id=3a0e6e305ad64223ab9e1663e798a4a9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:42.629609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7865e4-4973-492a-933f-ec6bd82dd7d7 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:42.630076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae822-4ba6-44ac-9ff3-25836abb993d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:42.633313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 61/119] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:42 2022] GET /identity/v3/users/3a0e6e305ad64223ab9e1663e798a4a9 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:42.634909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018fc3-3c76-448c-8ab6-8f8a7822beaa None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.635412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018fc3-3c76-448c-8ab6-8f8a7822beaa None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.635912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018fc3-3c76-448c-8ab6-8f8a7822beaa None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.637939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 62/120] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:42.638962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018fc3-3c76-448c-8ab6-8f8a7822beaa None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:42.645258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:42.672729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14b1d7-4560-47d9-ade6-a9da3bb29e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:42.673835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14b1d7-4560-47d9-ade6-a9da3bb29e44 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.674137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14b1d7-4560-47d9-ade6-a9da3bb29e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.674424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14b1d7-4560-47d9-ade6-a9da3bb29e44 None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.675853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14b1d7-4560-47d9-ade6-a9da3bb29e44 None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:42.677995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14b1d7-4560-47d9-ade6-a9da3bb29e44 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:42.680167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 59/121] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:42 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:42.681235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14b1d7-4560-47d9-ade6-a9da3bb29e44 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:42.776715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018fc3-3c76-448c-8ab6-8f8a7822beaa None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:42.791586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:42.809353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14b1d7-4560-47d9-ade6-a9da3bb29e44 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:42.827938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0461c-1505-48ca-99d1-65c2a0451636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:42.829621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0461c-1505-48ca-99d1-65c2a0451636 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.830092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0461c-1505-48ca-99d1-65c2a0451636 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.830554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0461c-1505-48ca-99d1-65c2a0451636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.844514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0461c-1505-48ca-99d1-65c2a0451636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:42.850571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0ad83-97ba-41f0-ba0d-4d2e46cad933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:42.851467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ad83-97ba-41f0-ba0d-4d2e46cad933 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.851939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ad83-97ba-41f0-ba0d-4d2e46cad933 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.852397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ad83-97ba-41f0-ba0d-4d2e46cad933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-d3a0461c-1505-48ca-99d1-65c2a0451636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:42.853775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:42.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:42.855386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 63/122] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:42.860802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced667-1b90-4280-8ed4-6ca4d05835af None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:42.860802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced667-1b90-4280-8ed4-6ca4d05835af None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:42.860802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced667-1b90-4280-8ed4-6ca4d05835af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:42.883329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3aced667-1b90-4280-8ed4-6ca4d05835af None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:42.885659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3aced667-1b90-4280-8ed4-6ca4d05835af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:42.926115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:42.953879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0ad83-97ba-41f0-ba0d-4d2e46cad933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:42.955598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0ad83-97ba-41f0-ba0d-4d2e46cad933 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:42.976943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 64/123] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:42.978030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced667-1b90-4280-8ed4-6ca4d05835af None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.083171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:43.088005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced667-1b90-4280-8ed4-6ca4d05835af None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:43.099878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 60/124] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:43.101390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0ad83-97ba-41f0-ba0d-4d2e46cad933 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.131135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f762536-563d-4114-a69c-e18e03ddc616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:43.132337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f762536-563d-4114-a69c-e18e03ddc616 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:43.133755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f762536-563d-4114-a69c-e18e03ddc616 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:43.133755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f762536-563d-4114-a69c-e18e03ddc616 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:43.134630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f762536-563d-4114-a69c-e18e03ddc616 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:43.136826 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f762536-563d-4114-a69c-e18e03ddc616 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:43.138996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 65/125] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:42 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:43.140571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f762536-563d-4114-a69c-e18e03ddc616 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.197076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:43.226148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0ad83-97ba-41f0-ba0d-4d2e46cad933 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:43.257774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f762536-563d-4114-a69c-e18e03ddc616 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:43.270849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:43.271876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:43.272670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:43.273108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:43.274272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:43.274896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:43.276766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:43.292754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 61/126] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:43.292754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.310239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680bba6-dd74-4cb0-ae53-7bdbc5c2c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:43.311671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bba6-dd74-4cb0-ae53-7bdbc5c2c6bd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:43.312478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bba6-dd74-4cb0-ae53-7bdbc5c2c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:43.312965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bba6-dd74-4cb0-ae53-7bdbc5c2c6bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:43.330996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680bba6-dd74-4cb0-ae53-7bdbc5c2c6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-6680bba6-dd74-4cb0-ae53-7bdbc5c2c6bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:43.340511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:43.341387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:43.342158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:43.347225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 66/127] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:43.348215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680bba6-dd74-4cb0-ae53-7bdbc5c2c6bd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.376709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:43.431077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0a5f-1688-4349-a73a-124e18ccc514 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:43.456005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680bba6-dd74-4cb0-ae53-7bdbc5c2c6bd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:43.482205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6c76-abdf-4751-be92-d20878374c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:43.484055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6c76-abdf-4751-be92-d20878374c62 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:43.484544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6c76-abdf-4751-be92-d20878374c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:43.485262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6c76-abdf-4751-be92-d20878374c62 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:43.487365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea6c76-abdf-4751-be92-d20878374c62 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:43.489610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea6c76-abdf-4751-be92-d20878374c62 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:43.491922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 62/128] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:43 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:43.492433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999dd0-f28b-465e-ae20-fc7dd03ff7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:43.493014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6c76-abdf-4751-be92-d20878374c62 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.493624 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999dd0-f28b-465e-ae20-fc7dd03ff7dd None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:43.494015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999dd0-f28b-465e-ae20-fc7dd03ff7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:43.494395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999dd0-f28b-465e-ae20-fc7dd03ff7dd None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32/users/4d27a9d64e924ced8ab73b7b339ccdcb/roles/69f0d114dbd94de3896c418607fa6e1a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:43.497045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da999dd0-f28b-465e-ae20-fc7dd03ff7dd None admin] RBAC: Authorizing `identity:create_grant(project_id=d0340b60166b4c069c60576799d26a32, user_id=4d27a9d64e924ced8ab73b7b339ccdcb, role_id=69f0d114dbd94de3896c418607fa6e1a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:43.498715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da999dd0-f28b-465e-ae20-fc7dd03ff7dd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:43.509410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:43.520598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 67/129] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:19:43 2022] PUT /identity/v3/projects/d0340b60166b4c069c60576799d26a32/users/4d27a9d64e924ced8ab73b7b339ccdcb/roles/69f0d114dbd94de3896c418607fa6e1a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:19:43.521781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999dd0-f28b-465e-ae20-fc7dd03ff7dd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.676200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6c76-abdf-4751-be92-d20878374c62 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:43.690530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:43.714154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da999dd0-f28b-465e-ae20-fc7dd03ff7dd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:43.731494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21c604-fbcd-487f-9f3b-1530106bb7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:43.733380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c604-fbcd-487f-9f3b-1530106bb7fa None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:43.733380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c604-fbcd-487f-9f3b-1530106bb7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:43.733380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21c604-fbcd-487f-9f3b-1530106bb7fa None admin] PATH_INFO: `/v3/users/117ad82133d0435087c48fd76e0b6541` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:43.736278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21c604-fbcd-487f-9f3b-1530106bb7fa None admin] RBAC: Authorizing `identity:get_user(user_id=117ad82133d0435087c48fd76e0b6541)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:43.737789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21c604-fbcd-487f-9f3b-1530106bb7fa None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:43.742130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 63/130] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:43 2022] GET /identity/v3/users/117ad82133d0435087c48fd76e0b6541 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:43.742752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21c604-fbcd-487f-9f3b-1530106bb7fa None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.783933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:43.785459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:43.785984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:43.786806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:43.788065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:43.788750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:43.791061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:43.802747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 68/131] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:43.804098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.841375 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:43.866095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21c604-fbcd-487f-9f3b-1530106bb7fa None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:43.916964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:43.918719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:43.919540 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:43.921976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:43.923650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] RBAC: Adding query filter params (role.id=8ca1560f736e42cc82249ede008d9bc3, scope.project.id=d0340b60166b4c069c60576799d26a32, user.id=3a0e6e305ad64223ab9e1663e798a4a9) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:43.924470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:43.927445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:43.940528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 64/132] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:43 2022] GET /identity/v3/role_assignments?user.id=3a0e6e305ad64223ab9e1663e798a4a9&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=8ca1560f736e42cc82249ede008d9bc3 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:43.942388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:43.962393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce23bb-880e-4030-b387-ccba55166bf7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:44.037598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f1cfb-7606-4bbf-8512-97e5392ab19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:44.038828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f1cfb-7606-4bbf-8512-97e5392ab19e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.039376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f1cfb-7606-4bbf-8512-97e5392ab19e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.039849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f1cfb-7606-4bbf-8512-97e5392ab19e None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.043668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f1cfb-7606-4bbf-8512-97e5392ab19e None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:44.045484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f1cfb-7606-4bbf-8512-97e5392ab19e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:44.049851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 69/133] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:43 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:44.078329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f1cfb-7606-4bbf-8512-97e5392ab19e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:44.109872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:44.168848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610f6e4-027b-4c3b-921b-c2fab177b6b5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:44.257240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f1cfb-7606-4bbf-8512-97e5392ab19e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:44.267651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55c60-9aa4-47b0-8c0d-4e02f30cb3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:44.268918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55c60-9aa4-47b0-8c0d-4e02f30cb3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.276284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55c60-9aa4-47b0-8c0d-4e02f30cb3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.277080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55c60-9aa4-47b0-8c0d-4e02f30cb3c9 None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.278977 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55c60-9aa4-47b0-8c0d-4e02f30cb3c9 None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:44.280805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55c60-9aa4-47b0-8c0d-4e02f30cb3c9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:44.283347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 65/134] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:43 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:44.285481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f9e4-d02c-485c-a2e8-5a06461e9c55 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.286181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f9e4-d02c-485c-a2e8-5a06461e9c55 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.286893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f9e4-d02c-485c-a2e8-5a06461e9c55 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.289639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 66/135] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:44.290640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79f9e4-d02c-485c-a2e8-5a06461e9c55 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:44.306051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:44.329957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5604c7b-1741-4033-a499-b5472370a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:44.331324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604c7b-1741-4033-a499-b5472370a72b None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.332538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604c7b-1741-4033-a499-b5472370a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.333049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604c7b-1741-4033-a499-b5472370a72b None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32/users/117ad82133d0435087c48fd76e0b6541/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.335620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5604c7b-1741-4033-a499-b5472370a72b None admin] RBAC: Authorizing `identity:create_grant(project_id=d0340b60166b4c069c60576799d26a32, user_id=117ad82133d0435087c48fd76e0b6541, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:44.337103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5604c7b-1741-4033-a499-b5472370a72b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:44.359405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 70/136] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:19:44 2022] PUT /identity/v3/projects/d0340b60166b4c069c60576799d26a32/users/117ad82133d0435087c48fd76e0b6541/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:19:44.364221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a2258-b577-4141-871e-b599bc8cc8c8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.364808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a2258-b577-4141-871e-b599bc8cc8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.365721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a2258-b577-4141-871e-b599bc8cc8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.401156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-901a2258-b577-4141-871e-b599bc8cc8c8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:44.403682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-901a2258-b577-4141-871e-b599bc8cc8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:44.509053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79f9e4-d02c-485c-a2e8-5a06461e9c55 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:44.531661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 71/137] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:44.532849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d1ff-926d-455c-a22a-e37b9fec39cc None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.533144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d1ff-926d-455c-a22a-e37b9fec39cc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.533428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d1ff-926d-455c-a22a-e37b9fec39cc None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.534697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 72/138] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:44.541071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def9ab8-2988-491f-8f49-abea5158c477 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.541808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def9ab8-2988-491f-8f49-abea5158c477 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.543326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def9ab8-2988-491f-8f49-abea5158c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.557647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:44.559270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33329c2-6b96-4359-a420-e0c8529c24fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:44.560446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33329c2-6b96-4359-a420-e0c8529c24fe None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.560954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33329c2-6b96-4359-a420-e0c8529c24fe None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.561442 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33329c2-6b96-4359-a420-e0c8529c24fe None admin] PATH_INFO: `/v3/projects/2ea7d70a61b34863a87e467e31674f88` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.562982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33329c2-6b96-4359-a420-e0c8529c24fe None admin] RBAC: Authorizing `identity:get_project(project_id=2ea7d70a61b34863a87e467e31674f88)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:44.564664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33329c2-6b96-4359-a420-e0c8529c24fe None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:44.565137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3def9ab8-2988-491f-8f49-abea5158c477 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:44.569672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3def9ab8-2988-491f-8f49-abea5158c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:44.570421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 67/139] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:44 2022] GET /identity/v3/projects/2ea7d70a61b34863a87e467e31674f88 => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:44.571518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33329c2-6b96-4359-a420-e0c8529c24fe None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:44.651264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 73/140] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:44.652131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def9ab8-2988-491f-8f49-abea5158c477 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:44.666175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:44.689906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33329c2-6b96-4359-a420-e0c8529c24fe None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:44.736781 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3394df-b413-44fe-92c4-92eb114a2f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:44.737996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3394df-b413-44fe-92c4-92eb114a2f96 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.738628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3394df-b413-44fe-92c4-92eb114a2f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.739257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3394df-b413-44fe-92c4-92eb114a2f96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.740709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3394df-b413-44fe-92c4-92eb114a2f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:44.742539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3394df-b413-44fe-92c4-92eb114a2f96 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:44.744562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 68/141] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:44.745689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3394df-b413-44fe-92c4-92eb114a2f96 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:44.794762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def9ab8-2988-491f-8f49-abea5158c477 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:44.829661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb25f9-733c-4259-bbc9-f2fa5d95540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:44.830565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb25f9-733c-4259-bbc9-f2fa5d95540f None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:44.830875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb25f9-733c-4259-bbc9-f2fa5d95540f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:44.831187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb25f9-733c-4259-bbc9-f2fa5d95540f None admin] PATH_INFO: `/v3/projects/2ea7d70a61b34863a87e467e31674f88/users/4d27a9d64e924ced8ab73b7b339ccdcb/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:44.833182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb25f9-733c-4259-bbc9-f2fa5d95540f None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea7d70a61b34863a87e467e31674f88, user_id=4d27a9d64e924ced8ab73b7b339ccdcb, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:44.834635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb25f9-733c-4259-bbc9-f2fa5d95540f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:44.838868 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:44.854801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 74/142] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:19:44 2022] PUT /identity/v3/projects/2ea7d70a61b34863a87e467e31674f88/users/4d27a9d64e924ced8ab73b7b339ccdcb/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:19:44.855676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb25f9-733c-4259-bbc9-f2fa5d95540f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:44.971461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3394df-b413-44fe-92c4-92eb114a2f96 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:45.042796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923eba-68b2-4184-8662-4d93342095b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:45.043697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923eba-68b2-4184-8662-4d93342095b4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:45.043987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923eba-68b2-4184-8662-4d93342095b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:45.044271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923eba-68b2-4184-8662-4d93342095b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:45.057420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb25f9-733c-4259-bbc9-f2fa5d95540f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:45.072100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55923eba-68b2-4184-8662-4d93342095b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-55923eba-68b2-4184-8662-4d93342095b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:45.080035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:45.080894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:45.081617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 69/143] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:45.087600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923eba-68b2-4184-8662-4d93342095b4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:45.095321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3d570-190d-4c98-9b61-5ae03931ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:45.096016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3d570-190d-4c98-9b61-5ae03931ced1 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:45.096309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3d570-190d-4c98-9b61-5ae03931ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:45.096590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3d570-190d-4c98-9b61-5ae03931ced1 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:45.097330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3d570-190d-4c98-9b61-5ae03931ced1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:45.098233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:45.099908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3d570-190d-4c98-9b61-5ae03931ced1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:45.134870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 75/144] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:19:44 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:45.210897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923eba-68b2-4184-8662-4d93342095b4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:45.249492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:45.250211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:45.250556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:45.250889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:45.251703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:45.252083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:45.253615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:45.263374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 70/145] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:45.268718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3d570-190d-4c98-9b61-5ae03931ced1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:45.328223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:45.382074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3d570-190d-4c98-9b61-5ae03931ced1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:45.418192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7253a-73a8-423b-a883-ef2fb4e3785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:45.419124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7253a-73a8-423b-a883-ef2fb4e3785c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:45.419418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7253a-73a8-423b-a883-ef2fb4e3785c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:45.419705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7253a-73a8-423b-a883-ef2fb4e3785c None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:45.420940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7253a-73a8-423b-a883-ef2fb4e3785c None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:45.422988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7253a-73a8-423b-a883-ef2fb4e3785c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:45.424705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 76/146] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:45 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:45.430143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:45.505083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:45.542904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66940151-e10e-410a-928a-ecbf867cf1d6 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:45.582946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b991f8-8ae0-4c0c-87ec-e6c7ee01f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:45.583564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b991f8-8ae0-4c0c-87ec-e6c7ee01f4fd None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:45.583861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b991f8-8ae0-4c0c-87ec-e6c7ee01f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:45.584147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b991f8-8ae0-4c0c-87ec-e6c7ee01f4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:45.656559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b991f8-8ae0-4c0c-87ec-e6c7ee01f4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:45.658061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b991f8-8ae0-4c0c-87ec-e6c7ee01f4fd None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:45.724053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:45.758913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 71/147] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:45.765410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7253a-73a8-423b-a883-ef2fb4e3785c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:45.884879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7253a-73a8-423b-a883-ef2fb4e3785c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:45.907012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:45.929371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e4dff-e729-43af-b52f-c2e44b33e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:45.930256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e4dff-e729-43af-b52f-c2e44b33e934 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:45.930544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e4dff-e729-43af-b52f-c2e44b33e934 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:45.930852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e4dff-e729-43af-b52f-c2e44b33e934 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:45.932154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e4dff-e729-43af-b52f-c2e44b33e934 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:45.933736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e4dff-e729-43af-b52f-c2e44b33e934 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:45.935661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 77/148] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:45 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:45.941302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b991f8-8ae0-4c0c-87ec-e6c7ee01f4fd None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:46.074960 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b991f8-8ae0-4c0c-87ec-e6c7ee01f4fd None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:46.119112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b346187-0dc8-4feb-8804-625283fc85e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:46.119794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346187-0dc8-4feb-8804-625283fc85e7 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:46.120086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346187-0dc8-4feb-8804-625283fc85e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:46.120372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346187-0dc8-4feb-8804-625283fc85e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:46.121228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b346187-0dc8-4feb-8804-625283fc85e7 None admin] RBAC: Adding query filter params (role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=d0340b60166b4c069c60576799d26a32, user.id=4d27a9d64e924ced8ab73b7b339ccdcb) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:46.121549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b346187-0dc8-4feb-8804-625283fc85e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:46.123036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b346187-0dc8-4feb-8804-625283fc85e7 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:46.129978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 72/149] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:45 2022] GET /identity/v3/role_assignments?user.id=4d27a9d64e924ced8ab73b7b339ccdcb&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:46.621498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaa2d8-87b5-47ff-a65c-700e8776611d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:46.621882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaa2d8-87b5-47ff-a65c-700e8776611d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:46.622076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaa2d8-87b5-47ff-a65c-700e8776611d None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:46.623509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 78/150] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:46.630321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7686a76-e416-4f4a-82e2-7c360fb34b3f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:46.630623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7686a76-e416-4f4a-82e2-7c360fb34b3f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:46.631010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7686a76-e416-4f4a-82e2-7c360fb34b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:46.649105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b7686a76-e416-4f4a-82e2-7c360fb34b3f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:46.650326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b7686a76-e416-4f4a-82e2-7c360fb34b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:46.678939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:46.733333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 73/151] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:46.772309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaa2d8-87b5-47ff-a65c-700e8776611d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:46.904536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaa2d8-87b5-47ff-a65c-700e8776611d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:46.950433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5dac9-92d7-4476-bdad-05d94d41ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:46.951326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5dac9-92d7-4476-bdad-05d94d41ea56 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:46.951621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5dac9-92d7-4476-bdad-05d94d41ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:46.951904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5dac9-92d7-4476-bdad-05d94d41ea56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:46.964225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5dac9-92d7-4476-bdad-05d94d41ea56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-20a5dac9-92d7-4476-bdad-05d94d41ea56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:46.973121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:46.973942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:46.975200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 79/152] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:19:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:46.980273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7686a76-e416-4f4a-82e2-7c360fb34b3f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:47.093055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7686a76-e416-4f4a-82e2-7c360fb34b3f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:47.134451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40d482-048a-46b4-9691-f5e2d42ef521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:47.135175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d482-048a-46b4-9691-f5e2d42ef521 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:47.135515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d482-048a-46b4-9691-f5e2d42ef521 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:47.135802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d482-048a-46b4-9691-f5e2d42ef521 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:47.136572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40d482-048a-46b4-9691-f5e2d42ef521 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:47.136887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40d482-048a-46b4-9691-f5e2d42ef521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:47.138312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40d482-048a-46b4-9691-f5e2d42ef521 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:47.147796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 74/153] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:19:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:47.154743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5dac9-92d7-4476-bdad-05d94d41ea56 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:47.227141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:47.243686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30514-0d4b-44ef-a653-24bd8f22b73e None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:47.243985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30514-0d4b-44ef-a653-24bd8f22b73e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:47.244263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30514-0d4b-44ef-a653-24bd8f22b73e None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:47.245871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 75/154] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:47.252217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6562e-439a-4752-94c7-dbbb773cca9d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:47.252515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6562e-439a-4752-94c7-dbbb773cca9d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:47.252803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6562e-439a-4752-94c7-dbbb773cca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:47.290669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-bfb6562e-439a-4752-94c7-dbbb773cca9d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:47.291964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-bfb6562e-439a-4752-94c7-dbbb773cca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:47.331234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:47.356935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5dac9-92d7-4476-bdad-05d94d41ea56 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:47.401617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 76/155] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:47.431558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb915c-0fc5-480b-acd4-8fa8eff8f0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:47.432376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb915c-0fc5-480b-acd4-8fa8eff8f0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:47.432663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb915c-0fc5-480b-acd4-8fa8eff8f0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:47.432943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb915c-0fc5-480b-acd4-8fa8eff8f0f8 None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:47.434192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb915c-0fc5-480b-acd4-8fa8eff8f0f8 None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:47.435693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb915c-0fc5-480b-acd4-8fa8eff8f0f8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:47.437623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 80/156] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:47 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:47.437727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6562e-439a-4752-94c7-dbbb773cca9d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:47.450009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb915c-0fc5-480b-acd4-8fa8eff8f0f8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:47.560129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb915c-0fc5-480b-acd4-8fa8eff8f0f8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:47.578808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:47.597736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34cff-fbd8-42f2-85c4-c05a5f869f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:47.598740 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34cff-fbd8-42f2-85c4-c05a5f869f29 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:47.599279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34cff-fbd8-42f2-85c4-c05a5f869f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:47.599754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34cff-fbd8-42f2-85c4-c05a5f869f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:47.660915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6562e-439a-4752-94c7-dbbb773cca9d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:47.683513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee34cff-fbd8-42f2-85c4-c05a5f869f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:47.685236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee34cff-fbd8-42f2-85c4-c05a5f869f29 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:47.756411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b293ce-4de2-49cf-9d1c-8bcc6cf7cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:47.756875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b293ce-4de2-49cf-9d1c-8bcc6cf7cb8a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:47.757173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b293ce-4de2-49cf-9d1c-8bcc6cf7cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:47.757484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b293ce-4de2-49cf-9d1c-8bcc6cf7cb8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:47.776385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b293ce-4de2-49cf-9d1c-8bcc6cf7cb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:47.789039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 81/157] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:19:47.790739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c06d-3db4-45e8-ba31-a797468145ba None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:47.791245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c06d-3db4-45e8-ba31-a797468145ba None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:47.791715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c06d-3db4-45e8-ba31-a797468145ba None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-63b293ce-4de2-49cf-9d1c-8bcc6cf7cb8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:47.792848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:47.793764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:47.794498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 77/158] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:47.795193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b293ce-4de2-49cf-9d1c-8bcc6cf7cb8a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:47.796131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 82/159] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:47.804279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34213ac9-c54d-4d51-b5f2-29afe694800f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:47.804855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34213ac9-c54d-4d51-b5f2-29afe694800f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:47.805420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34213ac9-c54d-4d51-b5f2-29afe694800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:47.832977 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:47.844440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-34213ac9-c54d-4d51-b5f2-29afe694800f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:47.846606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-34213ac9-c54d-4d51-b5f2-29afe694800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:47.874796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:47.994348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b293ce-4de2-49cf-9d1c-8bcc6cf7cb8a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:48.005289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 83/160] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:48.006089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34213ac9-c54d-4d51-b5f2-29afe694800f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:48.029455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86622fde-963e-494b-8dd6-a39d8ce0693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:48.030394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622fde-963e-494b-8dd6-a39d8ce0693c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.031294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622fde-963e-494b-8dd6-a39d8ce0693c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.031557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86622fde-963e-494b-8dd6-a39d8ce0693c None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.032841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86622fde-963e-494b-8dd6-a39d8ce0693c None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:48.034441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86622fde-963e-494b-8dd6-a39d8ce0693c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:48.036273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 78/161] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:47 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:48.038038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dedf3f-6a70-4e91-81dd-4eaa06cf0c84 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.038347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dedf3f-6a70-4e91-81dd-4eaa06cf0c84 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.038635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dedf3f-6a70-4e91-81dd-4eaa06cf0c84 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.044643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 79/162] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:48.045385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dedf3f-6a70-4e91-81dd-4eaa06cf0c84 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:48.139248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:48.158342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dedf3f-6a70-4e91-81dd-4eaa06cf0c84 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:48.199523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02f26-44d4-41d9-8922-12921d3c672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:48.201534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02f26-44d4-41d9-8922-12921d3c672a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.201827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02f26-44d4-41d9-8922-12921d3c672a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.202111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02f26-44d4-41d9-8922-12921d3c672a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.225269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c02f26-44d4-41d9-8922-12921d3c672a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-a5c02f26-44d4-41d9-8922-12921d3c672a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:48.241295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:48.242192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:48.242962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:48.244655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 80/163] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:48.246485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02f26-44d4-41d9-8922-12921d3c672a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:48.268556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34213ac9-c54d-4d51-b5f2-29afe694800f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:48.332856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460d02b-d127-4978-93c9-592b0ebc4518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:48.333551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d02b-d127-4978-93c9-592b0ebc4518 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.333846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d02b-d127-4978-93c9-592b0ebc4518 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.334133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d02b-d127-4978-93c9-592b0ebc4518 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.334924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460d02b-d127-4978-93c9-592b0ebc4518 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:48.335249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460d02b-d127-4978-93c9-592b0ebc4518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:48.336647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460d02b-d127-4978-93c9-592b0ebc4518 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:48.359320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 84/164] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:48.360828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478c12d-8d0a-49bf-812f-df2c2e9e1326 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.361126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478c12d-8d0a-49bf-812f-df2c2e9e1326 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.361414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478c12d-8d0a-49bf-812f-df2c2e9e1326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.362844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02f26-44d4-41d9-8922-12921d3c672a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:48.398917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f478c12d-8d0a-49bf-812f-df2c2e9e1326 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:48.400261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f478c12d-8d0a-49bf-812f-df2c2e9e1326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:48.400732 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:48.401457 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.401756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.402048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.402449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:48.403848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] RBAC: Adding query filter params (role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=d0340b60166b4c069c60576799d26a32, user.id=4d27a9d64e924ced8ab73b7b339ccdcb) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:48.404232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:48.405818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:48.413184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 81/165] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:48 2022] GET /identity/v3/role_assignments?user.id=4d27a9d64e924ced8ab73b7b339ccdcb&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:48.414492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:48.435251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:48.548283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 85/166] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:48.549091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478c12d-8d0a-49bf-812f-df2c2e9e1326 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:48.684327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ada1e-68a4-4f50-a5c7-e73c2252a2a4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:48.733448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:48.734669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.734986 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.735269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.736040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:48.736355 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:48.737773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:48.756726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 82/167] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:48.757581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:48.773589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478c12d-8d0a-49bf-812f-df2c2e9e1326 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:48.847671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270767f5-06b0-42a4-b427-5d9bab562c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:48.848849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270767f5-06b0-42a4-b427-5d9bab562c37 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.849301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270767f5-06b0-42a4-b427-5d9bab562c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.849726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270767f5-06b0-42a4-b427-5d9bab562c37 None admin] PATH_INFO: `/v3/users/3a0e6e305ad64223ab9e1663e798a4a9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.855579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270767f5-06b0-42a4-b427-5d9bab562c37 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0e6e305ad64223ab9e1663e798a4a9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:48.857343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270767f5-06b0-42a4-b427-5d9bab562c37 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:48.860298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 86/168] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:48 2022] GET /identity/v3/users/3a0e6e305ad64223ab9e1663e798a4a9 => generated 289 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:48.861222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270767f5-06b0-42a4-b427-5d9bab562c37 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:48.874113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:48.875459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:48.916965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cca928-328a-4fd5-8e28-f4746cdf3536 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:48.966133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc40ce-302c-4460-a5de-f288ba22b1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:48.967413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc40ce-302c-4460-a5de-f288ba22b1cd None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:48.967854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc40ce-302c-4460-a5de-f288ba22b1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:48.968817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc40ce-302c-4460-a5de-f288ba22b1cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:48.982676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc40ce-302c-4460-a5de-f288ba22b1cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-5abc40ce-302c-4460-a5de-f288ba22b1cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:48.998679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:49.000514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:49.002065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:49.005632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 83/169] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:49.011355 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc40ce-302c-4460-a5de-f288ba22b1cd None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:49.130725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270767f5-06b0-42a4-b427-5d9bab562c37 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:49.136764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc40ce-302c-4460-a5de-f288ba22b1cd None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:49.167047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:49.176616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b98ce-e857-4e5a-afcc-4b165a7a434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:49.177698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b98ce-e857-4e5a-afcc-4b165a7a434b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.178137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b98ce-e857-4e5a-afcc-4b165a7a434b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.178599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b98ce-e857-4e5a-afcc-4b165a7a434b None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.180287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b98ce-e857-4e5a-afcc-4b165a7a434b None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:49.181914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b98ce-e857-4e5a-afcc-4b165a7a434b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:49.183816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 84/170] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:49 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:49.184920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b98ce-e857-4e5a-afcc-4b165a7a434b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:49.229783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d5095-0387-4f29-b25f-e5079527758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:49.231003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5095-0387-4f29-b25f-e5079527758e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.231453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5095-0387-4f29-b25f-e5079527758e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.231878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5095-0387-4f29-b25f-e5079527758e None admin] PATH_INFO: `/v3/users/117ad82133d0435087c48fd76e0b6541` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.233227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d5095-0387-4f29-b25f-e5079527758e None admin] RBAC: Authorizing `identity:get_user(user_id=117ad82133d0435087c48fd76e0b6541)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:49.235411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d5095-0387-4f29-b25f-e5079527758e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:49.238623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 87/171] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:48 2022] GET /identity/v3/users/117ad82133d0435087c48fd76e0b6541 => generated 247 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:49.242972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d5095-0387-4f29-b25f-e5079527758e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:49.293591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b98ce-e857-4e5a-afcc-4b165a7a434b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:49.350849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:49.352215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.352691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.353619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.354842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:49.355307 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:49.357840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:49.362254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:49.368125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 85/172] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:49.369183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:49.395439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d5095-0387-4f29-b25f-e5079527758e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:49.434108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:49.445057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2890160-339f-4792-884e-6ee5a2712688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:49.446814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2890160-339f-4792-884e-6ee5a2712688 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.447532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2890160-339f-4792-884e-6ee5a2712688 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.447976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2890160-339f-4792-884e-6ee5a2712688 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32/users/3a0e6e305ad64223ab9e1663e798a4a9/roles/8ca1560f736e42cc82249ede008d9bc3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.451305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2890160-339f-4792-884e-6ee5a2712688 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0340b60166b4c069c60576799d26a32, user_id=3a0e6e305ad64223ab9e1663e798a4a9, role_id=8ca1560f736e42cc82249ede008d9bc3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:49.453480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2890160-339f-4792-884e-6ee5a2712688 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:49.471893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 88/173] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:19:49 2022] PUT /identity/v3/projects/d0340b60166b4c069c60576799d26a32/users/3a0e6e305ad64223ab9e1663e798a4a9/roles/8ca1560f736e42cc82249ede008d9bc3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:19:49.474030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91faec-2e5a-4597-a402-4d774989872a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.475015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91faec-2e5a-4597-a402-4d774989872a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.475467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91faec-2e5a-4597-a402-4d774989872a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.477432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 89/174] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:49.478409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91faec-2e5a-4597-a402-4d774989872a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:49.489864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f661f2-96e6-47a8-aa6a-b82e50349592 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:49.538637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb9ed6-f642-4f63-a36d-caaac9ede84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:49.539368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9ed6-f642-4f63-a36d-caaac9ede84e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.539865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9ed6-f642-4f63-a36d-caaac9ede84e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.540893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9ed6-f642-4f63-a36d-caaac9ede84e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.628602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91faec-2e5a-4597-a402-4d774989872a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:49.649381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb9ed6-f642-4f63-a36d-caaac9ede84e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:49.651079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb9ed6-f642-4f63-a36d-caaac9ede84e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:49.710815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11022f-47e0-47ce-bc9d-1ea5813a6999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:49.710815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11022f-47e0-47ce-bc9d-1ea5813a6999 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.710815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11022f-47e0-47ce-bc9d-1ea5813a6999 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.710815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11022f-47e0-47ce-bc9d-1ea5813a6999 None admin] PATH_INFO: `/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.711226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11022f-47e0-47ce-bc9d-1ea5813a6999 None admin] RBAC: Authorizing `identity:get_user(user_id=4d27a9d64e924ced8ab73b7b339ccdcb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:49.712166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11022f-47e0-47ce-bc9d-1ea5813a6999 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:49.713845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:49.714331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 90/175] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:49 2022] GET /identity/v3/users/4d27a9d64e924ced8ab73b7b339ccdcb => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:49.716226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1401-debf-4d2e-b154-c04b6ba1d76c None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.716695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1401-debf-4d2e-b154-c04b6ba1d76c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.716798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1401-debf-4d2e-b154-c04b6ba1d76c None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.718029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 91/176] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:49.722973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b093381-328c-406c-a493-6e93711a1fa2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.722973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b093381-328c-406c-a493-6e93711a1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.722973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b093381-328c-406c-a493-6e93711a1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.726600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:49.738506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7b093381-328c-406c-a493-6e93711a1fa2 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:49.740514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7b093381-328c-406c-a493-6e93711a1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:49.778757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 86/177] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:49.778757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f6ae-97d0-439e-9a68-eac93ba783b1 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.778757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f6ae-97d0-439e-9a68-eac93ba783b1 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.778757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6f6ae-97d0-439e-9a68-eac93ba783b1 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.778757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 87/178] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:49.778757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6f6ae-97d0-439e-9a68-eac93ba783b1 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:49.833053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 92/179] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:49.834354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f3838-8214-4da8-ada3-6efb866685e9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.834670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f3838-8214-4da8-ada3-6efb866685e9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.834995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f3838-8214-4da8-ada3-6efb866685e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.851937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-351f3838-8214-4da8-ada3-6efb866685e9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:49.853202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-351f3838-8214-4da8-ada3-6efb866685e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:49.924026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6f6ae-97d0-439e-9a68-eac93ba783b1 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:49.926612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 93/180] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:49.928105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03bb6b-89ee-49a4-8fe6-0b361de01a05 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.928524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03bb6b-89ee-49a4-8fe6-0b361de01a05 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.928927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03bb6b-89ee-49a4-8fe6-0b361de01a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:49.949480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ff03bb6b-89ee-49a4-8fe6-0b361de01a05 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:49.951884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ff03bb6b-89ee-49a4-8fe6-0b361de01a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:49.991897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd19de-9c74-4768-9e43-60c65b6e9f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:49.992572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd19de-9c74-4768-9e43-60c65b6e9f07 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:49.993070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd19de-9c74-4768-9e43-60c65b6e9f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:49.993365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd19de-9c74-4768-9e43-60c65b6e9f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.028787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:50.034108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:50.041888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 94/181] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:50.043044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03bb6b-89ee-49a4-8fe6-0b361de01a05 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.095638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd19de-9c74-4768-9e43-60c65b6e9f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:50.097680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd19de-9c74-4768-9e43-60c65b6e9f07 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:50.160036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03bb6b-89ee-49a4-8fe6-0b361de01a05 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.196053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4962f-253f-4d7b-93b2-b569aa939a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.196846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4962f-253f-4d7b-93b2-b569aa939a1b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.197135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4962f-253f-4d7b-93b2-b569aa939a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.197417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4962f-253f-4d7b-93b2-b569aa939a1b None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.198603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4962f-253f-4d7b-93b2-b569aa939a1b None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:50.200112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4962f-253f-4d7b-93b2-b569aa939a1b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:50.201976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 95/182] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:50.202665 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4962f-253f-4d7b-93b2-b569aa939a1b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.213451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 88/183] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:50.213451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd19de-9c74-4768-9e43-60c65b6e9f07 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.269052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:50.269487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:50.313379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd19de-9c74-4768-9e43-60c65b6e9f07 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.315463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4962f-253f-4d7b-93b2-b569aa939a1b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.351326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0100-dd8d-4028-9c92-d0951d632e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.351508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968d4a-ae8e-41fa-8279-9c2274c954f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.352142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968d4a-ae8e-41fa-8279-9c2274c954f8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.352240 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0100-dd8d-4028-9c92-d0951d632e6d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.352430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0100-dd8d-4028-9c92-d0951d632e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.352531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968d4a-ae8e-41fa-8279-9c2274c954f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.352710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968d4a-ae8e-41fa-8279-9c2274c954f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.352802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0100-dd8d-4028-9c92-d0951d632e6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.363743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af968d4a-ae8e-41fa-8279-9c2274c954f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:50.363857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0100-dd8d-4028-9c92-d0951d632e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-af968d4a-ae8e-41fa-8279-9c2274c954f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:50.371481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:50.372294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:50.373061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-541c0100-dd8d-4028-9c92-d0951d632e6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:50.373627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:50.374409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:50.376670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:50.377246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 96/184] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:50.377310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 89/185] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:50.377310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0100-dd8d-4028-9c92-d0951d632e6d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.378799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968d4a-ae8e-41fa-8279-9c2274c954f8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.483329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0100-dd8d-4028-9c92-d0951d632e6d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.483713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968d4a-ae8e-41fa-8279-9c2274c954f8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.500687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:50.506873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:50.520691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.521420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.521710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.522016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.522890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d0340b60166b4c069c60576799d26a32, user.id=117ad82133d0435087c48fd76e0b6541) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:50.523211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:50.523647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4accfd-9eaa-4f9f-8240-a5d903439f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.524590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4accfd-9eaa-4f9f-8240-a5d903439f49 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.524740 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:50.525149 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4accfd-9eaa-4f9f-8240-a5d903439f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.525558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4accfd-9eaa-4f9f-8240-a5d903439f49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.526882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4accfd-9eaa-4f9f-8240-a5d903439f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:50.528701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4accfd-9eaa-4f9f-8240-a5d903439f49 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:50.530455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 97/186] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:50.531981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 90/187] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/role_assignments?user.id=117ad82133d0435087c48fd76e0b6541&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:50.532423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4accfd-9eaa-4f9f-8240-a5d903439f49 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.532684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.665248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4accfd-9eaa-4f9f-8240-a5d903439f49 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.674427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8675d-8679-41e9-948b-159e356036e5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.709410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9127d2-a8a8-4ada-9d32-9471262faee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.710317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9127d2-a8a8-4ada-9d32-9471262faee1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.710603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9127d2-a8a8-4ada-9d32-9471262faee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.710910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9127d2-a8a8-4ada-9d32-9471262faee1 None admin] PATH_INFO: `/v3/projects/2ea7d70a61b34863a87e467e31674f88` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.712249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9127d2-a8a8-4ada-9d32-9471262faee1 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea7d70a61b34863a87e467e31674f88)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:50.713711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9127d2-a8a8-4ada-9d32-9471262faee1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:50.715616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 98/188] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/projects/2ea7d70a61b34863a87e467e31674f88 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:50.716311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9127d2-a8a8-4ada-9d32-9471262faee1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.724403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.725971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.726268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.726552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.727347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:50.727661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:50.729068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:50.739489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 91/189] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:50.740562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.799367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:50.802148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:50.854296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9127d2-a8a8-4ada-9d32-9471262faee1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.862758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc8111-b301-41b7-92d9-9ae7c0f930ef None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:50.886691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.887416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.887704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.887994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.888746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:50.889056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:50.890972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:50.898256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744752a-5c9b-457e-8ac2-c89a4b73265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:50.903649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 99/190] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:50.903771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744752a-5c9b-457e-8ac2-c89a4b73265c None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:50.903771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744752a-5c9b-457e-8ac2-c89a4b73265c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:50.903771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744752a-5c9b-457e-8ac2-c89a4b73265c None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:50.903973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:50.904038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744752a-5c9b-457e-8ac2-c89a4b73265c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:50.904038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744752a-5c9b-457e-8ac2-c89a4b73265c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:50.934815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 92/191] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:19:50 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:50.934815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744752a-5c9b-457e-8ac2-c89a4b73265c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:51.035401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba10ba6-be89-4f86-b967-fa2c0890e8a8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:51.058260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:51.079245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:51.082438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744752a-5c9b-457e-8ac2-c89a4b73265c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:51.090294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:51.090294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.090294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.090294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.090657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] RBAC: Adding query filter params (role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=2ea7d70a61b34863a87e467e31674f88, user.id=4d27a9d64e924ced8ab73b7b339ccdcb) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:51.090657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:51.092262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:51.101387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 100/192] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/role_assignments?user.id=4d27a9d64e924ced8ab73b7b339ccdcb&scope.project.id=2ea7d70a61b34863a87e467e31674f88&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:51.101387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:51.131217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e7c8-4c91-4780-a132-86a143d68b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:51.132387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e7c8-4c91-4780-a132-86a143d68b1c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.132671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e7c8-4c91-4780-a132-86a143d68b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.132953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e7c8-4c91-4780-a132-86a143d68b1c None admin] PATH_INFO: `/v3/users/c16604b4fc634af2b77e187d65d67350` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.159906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831e7c8-4c91-4780-a132-86a143d68b1c None admin] RBAC: Authorizing `identity:get_user(user_id=c16604b4fc634af2b77e187d65d67350)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:51.159906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831e7c8-4c91-4780-a132-86a143d68b1c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:51.161332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 93/193] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:50 2022] GET /identity/v3/users/c16604b4fc634af2b77e187d65d67350 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:51.169190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e7c8-4c91-4780-a132-86a143d68b1c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:51.246596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ca66-c52f-4c55-bebf-2a521a856002 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:51.284111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a668d0-9aed-41a7-a1d8-95ab2b1194aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:51.285034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a668d0-9aed-41a7-a1d8-95ab2b1194aa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.285340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a668d0-9aed-41a7-a1d8-95ab2b1194aa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.285672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a668d0-9aed-41a7-a1d8-95ab2b1194aa None admin] PATH_INFO: `/v3/users/c16604b4fc634af2b77e187d65d67350` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.286893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a668d0-9aed-41a7-a1d8-95ab2b1194aa None admin] RBAC: Authorizing `identity:get_user(user_id=c16604b4fc634af2b77e187d65d67350)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:51.288339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a668d0-9aed-41a7-a1d8-95ab2b1194aa None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:51.290172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 101/194] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:51 2022] GET /identity/v3/users/c16604b4fc634af2b77e187d65d67350 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:51.295357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a668d0-9aed-41a7-a1d8-95ab2b1194aa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:51.296394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e7c8-4c91-4780-a132-86a143d68b1c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:51.336632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e9e48-8246-438c-b895-3498e1711de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:51.337673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e9e48-8246-438c-b895-3498e1711de3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.338102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e9e48-8246-438c-b895-3498e1711de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.338523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e9e48-8246-438c-b895-3498e1711de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.358810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:51.379435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:51.436067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a668d0-9aed-41a7-a1d8-95ab2b1194aa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:51.446665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e9e48-8246-438c-b895-3498e1711de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:51.448971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e9e48-8246-438c-b895-3498e1711de3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:51.481356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9caa9-a121-45a6-b19b-82e96e726896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:51.482029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9caa9-a121-45a6-b19b-82e96e726896 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.482320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9caa9-a121-45a6-b19b-82e96e726896 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.482601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9caa9-a121-45a6-b19b-82e96e726896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.564905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 94/195] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:51.571744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e9e48-8246-438c-b895-3498e1711de3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:51.583333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9caa9-a121-45a6-b19b-82e96e726896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:51.584818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9caa9-a121-45a6-b19b-82e96e726896 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:51.649645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:51.650724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:51.696853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e9e48-8246-438c-b895-3498e1711de3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:51.726449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 102/196] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:19:51.727876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2908-4a81-4257-87a1-fb08b5ed7260 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.728173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2908-4a81-4257-87a1-fb08b5ed7260 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.728459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2908-4a81-4257-87a1-fb08b5ed7260 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.729821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 103/197] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:51.736155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2908-4a81-4257-87a1-fb08b5ed7260 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:51.739812 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358860ca-a3c2-42b4-ba84-2b947d23a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:51.740755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358860ca-a3c2-42b4-ba84-2b947d23a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.741040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358860ca-a3c2-42b4-ba84-2b947d23a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.741363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358860ca-a3c2-42b4-ba84-2b947d23a8e3 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.742587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358860ca-a3c2-42b4-ba84-2b947d23a8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:51.744155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358860ca-a3c2-42b4-ba84-2b947d23a8e3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:51.746168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 95/198] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:51 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:51.747443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7e264-e6db-4cbb-95fe-7a8a9e0be8e0 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.747738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7e264-e6db-4cbb-95fe-7a8a9e0be8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.748018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7e264-e6db-4cbb-95fe-7a8a9e0be8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.765611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-36f7e264-e6db-4cbb-95fe-7a8a9e0be8e0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:51.766829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-36f7e264-e6db-4cbb-95fe-7a8a9e0be8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:51.848321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 96/199] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:51.848321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7e264-e6db-4cbb-95fe-7a8a9e0be8e0 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:51.872798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2908-4a81-4257-87a1-fb08b5ed7260 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:51.911500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:51.922235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d9b91-96d3-473c-95f1-5f6676d04101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:51.923403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9b91-96d3-473c-95f1-5f6676d04101 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:51.924255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9b91-96d3-473c-95f1-5f6676d04101 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:51.924565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9b91-96d3-473c-95f1-5f6676d04101 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:51.926058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d9b91-96d3-473c-95f1-5f6676d04101 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:51.928655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d9b91-96d3-473c-95f1-5f6676d04101 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:51.930401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 104/200] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:51 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:51.931213 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d9b91-96d3-473c-95f1-5f6676d04101 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:51.954652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:51.967454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7e264-e6db-4cbb-95fe-7a8a9e0be8e0 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:52.004792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:52.005544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:52.005892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:52.006236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:52.007198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=312f010075904c318a115286ea12a499, user.id=c16604b4fc634af2b77e187d65d67350) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:52.007696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:52.009429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:52.015979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 97/201] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:51 2022] GET /identity/v3/role_assignments?user.id=c16604b4fc634af2b77e187d65d67350&scope.project.id=312f010075904c318a115286ea12a499&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:52.016741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:52.070845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d9b91-96d3-473c-95f1-5f6676d04101 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:52.132554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511843-0e49-44e3-8545-e3d3d0a21545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:52.134478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511843-0e49-44e3-8545-e3d3d0a21545 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:52.134807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511843-0e49-44e3-8545-e3d3d0a21545 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:52.135104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511843-0e49-44e3-8545-e3d3d0a21545 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:52.161617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511843-0e49-44e3-8545-e3d3d0a21545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-72511843-0e49-44e3-8545-e3d3d0a21545 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:52.173589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:52.175793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:52.177834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 105/202] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:52.188318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511843-0e49-44e3-8545-e3d3d0a21545 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:52.193531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed18b-994b-4eeb-ac83-443ef900e8c6 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:52.227622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:52.260361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:52.261393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:52.261883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:52.262364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:52.263454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] RBAC: Adding query filter params (role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=312f010075904c318a115286ea12a499, user.id=c16604b4fc634af2b77e187d65d67350) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:52.264009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:52.265717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:52.282382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:52.284604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 98/203] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:52 2022] GET /identity/v3/role_assignments?user.id=c16604b4fc634af2b77e187d65d67350&scope.project.id=312f010075904c318a115286ea12a499&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:52.307697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511843-0e49-44e3-8545-e3d3d0a21545 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:52.345730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:52.346720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:52.347227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:52.347677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:52.348613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:52.349109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:52.350745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:52.360061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 106/204] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:52.365816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:52.504945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b274e-3051-4359-9694-53583370e71d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:52.540182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202c331-9619-4ebe-a250-836ed9365fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:52.541121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c331-9619-4ebe-a250-836ed9365fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:52.541417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c331-9619-4ebe-a250-836ed9365fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:52.541696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202c331-9619-4ebe-a250-836ed9365fc4 None admin] PATH_INFO: `/v3/users/3a0e6e305ad64223ab9e1663e798a4a9` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:52.542949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202c331-9619-4ebe-a250-836ed9365fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=3a0e6e305ad64223ab9e1663e798a4a9)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:52.544427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202c331-9619-4ebe-a250-836ed9365fc4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:52.546060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 99/205] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:52 2022] GET /identity/v3/users/3a0e6e305ad64223ab9e1663e798a4a9 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:52.552328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:52.687028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176904d-0f2c-4995-bd7f-fcce6eb5b52e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:52.733840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a68d7-4353-420e-b0de-ca5a858e1805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:52.735171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a68d7-4353-420e-b0de-ca5a858e1805 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:52.735472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a68d7-4353-420e-b0de-ca5a858e1805 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:52.735765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a68d7-4353-420e-b0de-ca5a858e1805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:52.753327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:52.821691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a68d7-4353-420e-b0de-ca5a858e1805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:52.823117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a68d7-4353-420e-b0de-ca5a858e1805 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:52.950456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 107/206] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:52.956176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202c331-9619-4ebe-a250-836ed9365fc4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:53.011068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:53.061749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202c331-9619-4ebe-a250-836ed9365fc4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:53.096071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcea4f0-4901-4f22-8533-5c4890afa808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:53.096864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea4f0-4901-4f22-8533-5c4890afa808 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:53.097152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea4f0-4901-4f22-8533-5c4890afa808 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:53.097431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea4f0-4901-4f22-8533-5c4890afa808 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:53.098627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcea4f0-4901-4f22-8533-5c4890afa808 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:53.100146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcea4f0-4901-4f22-8533-5c4890afa808 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:53.101842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 100/207] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:52 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:53.107947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a68d7-4353-420e-b0de-ca5a858e1805 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:53.166505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:53.246828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a68d7-4353-420e-b0de-ca5a858e1805 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:53.295630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9882ee-19e6-45ca-bf15-68a08ae12168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:53.296324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9882ee-19e6-45ca-bf15-68a08ae12168 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:53.296588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9882ee-19e6-45ca-bf15-68a08ae12168 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:53.296910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9882ee-19e6-45ca-bf15-68a08ae12168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:53.297756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9882ee-19e6-45ca-bf15-68a08ae12168 None admin] RBAC: Adding query filter params (role.id=8ca1560f736e42cc82249ede008d9bc3, scope.project.id=d0340b60166b4c069c60576799d26a32, user.id=3a0e6e305ad64223ab9e1663e798a4a9) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:53.298070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9882ee-19e6-45ca-bf15-68a08ae12168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:53.299557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9882ee-19e6-45ca-bf15-68a08ae12168 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:53.311359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 108/208] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:53 2022] GET /identity/v3/role_assignments?user.id=3a0e6e305ad64223ab9e1663e798a4a9&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=8ca1560f736e42cc82249ede008d9bc3 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:53.723686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53951-d3f7-4c1f-9ced-32a46bb970f6 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:53.724186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53951-d3f7-4c1f-9ced-32a46bb970f6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:53.724290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53951-d3f7-4c1f-9ced-32a46bb970f6 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:53.725628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 101/209] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:53.731092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd9e7b-dfa9-4791-9567-c2029fb83e4c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:53.731393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd9e7b-dfa9-4791-9567-c2029fb83e4c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:53.731679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd9e7b-dfa9-4791-9567-c2029fb83e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:53.750544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-74bd9e7b-dfa9-4791-9567-c2029fb83e4c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:53.751853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-74bd9e7b-dfa9-4791-9567-c2029fb83e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:53.828714 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85346dd-e127-43ac-8adf-d8959095bdac None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:53.829094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85346dd-e127-43ac-8adf-d8959095bdac None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:53.829265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85346dd-e127-43ac-8adf-d8959095bdac None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:53.830659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 102/210] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:53.835241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 109/211] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:53.836377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec36a69-a46e-499c-89b6-323ee1eed262 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:53.836678 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec36a69-a46e-499c-89b6-323ee1eed262 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:53.836965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec36a69-a46e-499c-89b6-323ee1eed262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:53.854951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-eec36a69-a46e-499c-89b6-323ee1eed262 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:53.856158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eec36a69-a46e-499c-89b6-323ee1eed262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:53.861571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd9e7b-dfa9-4791-9567-c2029fb83e4c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:53.896511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:53.929347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 103/212] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:53.954668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec36a69-a46e-499c-89b6-323ee1eed262 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:53.966569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd9e7b-dfa9-4791-9567-c2029fb83e4c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:54.001351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e72d-0c5c-4079-8447-7aba924046cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:54.002086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e72d-0c5c-4079-8447-7aba924046cd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.002372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e72d-0c5c-4079-8447-7aba924046cd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.002650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e72d-0c5c-4079-8447-7aba924046cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.004991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:54.013709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e72d-0c5c-4079-8447-7aba924046cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a221e72d-0c5c-4079-8447-7aba924046cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:54.022129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:54.023044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:54.023834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 110/213] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:19:54.029431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e72d-0c5c-4079-8447-7aba924046cd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:54.056899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec36a69-a46e-499c-89b6-323ee1eed262 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:54.092116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19827-2082-4ff8-a940-25a8967e817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:54.092929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19827-2082-4ff8-a940-25a8967e817c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.093217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19827-2082-4ff8-a940-25a8967e817c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.093496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19827-2082-4ff8-a940-25a8967e817c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.094715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c19827-2082-4ff8-a940-25a8967e817c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:54.096222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c19827-2082-4ff8-a940-25a8967e817c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:54.097838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 104/214] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:54.103106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19827-2082-4ff8-a940-25a8967e817c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:54.147450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:54.155748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e72d-0c5c-4079-8447-7aba924046cd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:54.194178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:54.195158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.195635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.196082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.197077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:54.197609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:54.199203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:54.213109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19827-2082-4ff8-a940-25a8967e817c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:54.213414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 111/215] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:54.214568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:54.231466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:54.249851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2faa-f8c4-4436-8d4c-859d1da85aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:54.250472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2faa-f8c4-4436-8d4c-859d1da85aff None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.250760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2faa-f8c4-4436-8d4c-859d1da85aff None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.251068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2faa-f8c4-4436-8d4c-859d1da85aff None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.251836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f2faa-f8c4-4436-8d4c-859d1da85aff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:54.253247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f2faa-f8c4-4436-8d4c-859d1da85aff None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:54.278941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 105/216] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:19:54 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:19:54.352664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d060c-49ac-4f6a-b1d4-fd3bbedc553e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:54.394645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997330bd-c4b5-4fd5-83f4-521d2fc1139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:54.395596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997330bd-c4b5-4fd5-83f4-521d2fc1139b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.395889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997330bd-c4b5-4fd5-83f4-521d2fc1139b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.396175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997330bd-c4b5-4fd5-83f4-521d2fc1139b None admin] PATH_INFO: `/v3/users/1d1f467394e64952971d1d37c5066a8c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.413554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997330bd-c4b5-4fd5-83f4-521d2fc1139b None admin] RBAC: Authorizing `identity:get_user(user_id=1d1f467394e64952971d1d37c5066a8c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:54.415196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997330bd-c4b5-4fd5-83f4-521d2fc1139b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:54.417401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 112/217] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:54 2022] GET /identity/v3/users/1d1f467394e64952971d1d37c5066a8c => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:54.423721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2faa-f8c4-4436-8d4c-859d1da85aff None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:54.465307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2136-ff1f-43ed-a4e4-b2c891fb4359 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.465638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2136-ff1f-43ed-a4e4-b2c891fb4359 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.465893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2136-ff1f-43ed-a4e4-b2c891fb4359 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.467334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 113/218] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:19:54.472936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6a082-e939-4f12-92ab-3cf4b33f77a8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.473216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6a082-e939-4f12-92ab-3cf4b33f77a8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.473502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6a082-e939-4f12-92ab-3cf4b33f77a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.494139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a6d6a082-e939-4f12-92ab-3cf4b33f77a8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:54.495571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a6d6a082-e939-4f12-92ab-3cf4b33f77a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:54.508705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:54.540597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2faa-f8c4-4436-8d4c-859d1da85aff None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:54.585758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af01fed-274d-48da-b35a-8fad81065d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:54.586880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01fed-274d-48da-b35a-8fad81065d58 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.587379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01fed-274d-48da-b35a-8fad81065d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.587841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 114/219] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:54.588063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01fed-274d-48da-b35a-8fad81065d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.616740 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6a082-e939-4f12-92ab-3cf4b33f77a8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:54.643636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:54.675569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01fed-274d-48da-b35a-8fad81065d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:54.677160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01fed-274d-48da-b35a-8fad81065d58 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:54.726945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6a082-e939-4f12-92ab-3cf4b33f77a8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:54.768496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ddfb1-ba8a-4543-8d31-6efa5b52dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:54.769236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ddfb1-ba8a-4543-8d31-6efa5b52dcad None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.769685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ddfb1-ba8a-4543-8d31-6efa5b52dcad None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.769976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ddfb1-ba8a-4543-8d31-6efa5b52dcad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.783779 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ddfb1-ba8a-4543-8d31-6efa5b52dcad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4e2ddfb1-ba8a-4543-8d31-6efa5b52dcad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:54.791669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:54.792528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:54.793282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 115/220] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:54.794638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c2e6-254f-416b-b862-f42e41c52120 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.794638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c2e6-254f-416b-b862-f42e41c52120 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.794812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c2e6-254f-416b-b862-f42e41c52120 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.796119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 116/221] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:54.800179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 106/222] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:19:54.805118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c2e6-254f-416b-b862-f42e41c52120 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:54.807435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8adb6-ab8a-4c3b-84b4-565c2ce4e51d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:54.807931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8adb6-ab8a-4c3b-84b4-565c2ce4e51d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:54.808407 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8adb6-ab8a-4c3b-84b4-565c2ce4e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:54.808800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:54.829017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-94e8adb6-ab8a-4c3b-84b4-565c2ce4e51d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:54.831075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-94e8adb6-ab8a-4c3b-84b4-565c2ce4e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:54.914794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 107/223] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:54.914794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8adb6-ab8a-4c3b-84b4-565c2ce4e51d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:54.918759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:54.964885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c2e6-254f-416b-b862-f42e41c52120 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.008281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.008975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.009308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.009593 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.010608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:55.010715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.012232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.021923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 117/224] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:55.022746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:55.046332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8adb6-ab8a-4c3b-84b4-565c2ce4e51d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.089749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879ea1-f029-442b-a617-3b82ee8a3ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.091743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879ea1-f029-442b-a617-3b82ee8a3ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.092238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879ea1-f029-442b-a617-3b82ee8a3ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.092922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879ea1-f029-442b-a617-3b82ee8a3ff8 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.094978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879ea1-f029-442b-a617-3b82ee8a3ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.097234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879ea1-f029-442b-a617-3b82ee8a3ff8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.100347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 108/225] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:54 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:55.101474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879ea1-f029-442b-a617-3b82ee8a3ff8 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:55.103190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:55.155966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240df027-48d1-4735-8154-586ae55712a4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.186203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:55.203047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310926-4552-4997-9c3c-ce1ca423d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.205250 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310926-4552-4997-9c3c-ce1ca423d23c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.205720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310926-4552-4997-9c3c-ce1ca423d23c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.206206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310926-4552-4997-9c3c-ce1ca423d23c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.220892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50310926-4552-4997-9c3c-ce1ca423d23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:55.222241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879ea1-f029-442b-a617-3b82ee8a3ff8 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-50310926-4552-4997-9c3c-ce1ca423d23c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:55.231225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:55.232133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:55.232876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:55.235863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 118/226] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:19:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:55.238196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310926-4552-4997-9c3c-ce1ca423d23c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:55.275028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b914-4603-4d20-8103-e0f5b98a820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.276782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b914-4603-4d20-8103-e0f5b98a820f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.277499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b914-4603-4d20-8103-e0f5b98a820f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.277929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b914-4603-4d20-8103-e0f5b98a820f None admin] PATH_INFO: `/v3/users/c16604b4fc634af2b77e187d65d67350` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.279665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7b914-4603-4d20-8103-e0f5b98a820f None admin] RBAC: Authorizing `identity:get_user(user_id=c16604b4fc634af2b77e187d65d67350)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.282436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7b914-4603-4d20-8103-e0f5b98a820f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.284281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 109/227] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:55 2022] GET /identity/v3/users/c16604b4fc634af2b77e187d65d67350 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:55.285250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b914-4603-4d20-8103-e0f5b98a820f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:55.357657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310926-4552-4997-9c3c-ce1ca423d23c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.388609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:55.398302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b914-4603-4d20-8103-e0f5b98a820f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.398856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.399684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.400242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.400667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.401757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] RBAC: Adding query filter params (role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=312f010075904c318a115286ea12a499, user.id=1d1f467394e64952971d1d37c5066a8c) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:55.402216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.404101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.410318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 119/228] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:55 2022] GET /identity/v3/role_assignments?user.id=1d1f467394e64952971d1d37c5066a8c&scope.project.id=312f010075904c318a115286ea12a499&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:55.411465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:55.438207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.438761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.439151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.439534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.440492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:55.440803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.442191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.455994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 110/229] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:19:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:55.457879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:55.462309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:55.550258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc2d96-1984-4f65-b4ee-469636fa82fa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.615739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615898-5d06-4cfe-8b4e-b09c1221c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.617216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ac7c-4c84-4377-b629-407554f4ca8a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.619295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615898-5d06-4cfe-8b4e-b09c1221c27f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.619581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615898-5d06-4cfe-8b4e-b09c1221c27f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.619858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615898-5d06-4cfe-8b4e-b09c1221c27f None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.621245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615898-5d06-4cfe-8b4e-b09c1221c27f None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.623989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615898-5d06-4cfe-8b4e-b09c1221c27f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.632066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 120/230] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:55 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:55.646639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615898-5d06-4cfe-8b4e-b09c1221c27f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:55.699024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908f2c8-6439-4ba8-baf7-66c1ea9031da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.701396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908f2c8-6439-4ba8-baf7-66c1ea9031da None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.702309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908f2c8-6439-4ba8-baf7-66c1ea9031da None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.703598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908f2c8-6439-4ba8-baf7-66c1ea9031da None admin] PATH_INFO: `/v3/users/c16604b4fc634af2b77e187d65d67350` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.705328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908f2c8-6439-4ba8-baf7-66c1ea9031da None admin] RBAC: Authorizing `identity:get_user(user_id=c16604b4fc634af2b77e187d65d67350)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.709042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908f2c8-6439-4ba8-baf7-66c1ea9031da None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.712073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 111/231] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:55 2022] GET /identity/v3/users/c16604b4fc634af2b77e187d65d67350 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:55.718500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908f2c8-6439-4ba8-baf7-66c1ea9031da None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:55.730734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:55.820611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615898-5d06-4cfe-8b4e-b09c1221c27f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.845768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:55.866790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c28c-7759-4e1a-8148-3d836319040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.867913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c28c-7759-4e1a-8148-3d836319040e None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.868210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c28c-7759-4e1a-8148-3d836319040e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.868866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c28c-7759-4e1a-8148-3d836319040e None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499/users/c16604b4fc634af2b77e187d65d67350/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.870509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c28c-7759-4e1a-8148-3d836319040e None admin] RBAC: Authorizing `identity:create_grant(project_id=312f010075904c318a115286ea12a499, user_id=c16604b4fc634af2b77e187d65d67350, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.872015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c28c-7759-4e1a-8148-3d836319040e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.882374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908f2c8-6439-4ba8-baf7-66c1ea9031da None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:55.889110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 121/232] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:19:55 2022] PUT /identity/v3/projects/312f010075904c318a115286ea12a499/users/c16604b4fc634af2b77e187d65d67350/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:19:55.926885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b80a-dd0f-42ba-a74b-5d31c431586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:55.928003 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b80a-dd0f-42ba-a74b-5d31c431586d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:55.928432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b80a-dd0f-42ba-a74b-5d31c431586d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:55.928849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b80a-dd0f-42ba-a74b-5d31c431586d None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:55.930236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673b80a-dd0f-42ba-a74b-5d31c431586d None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:55.931924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673b80a-dd0f-42ba-a74b-5d31c431586d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:55.934105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 112/233] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:55 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:55.940355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c28c-7759-4e1a-8148-3d836319040e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:56.052326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c28c-7759-4e1a-8148-3d836319040e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:56.075308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:56.089134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4df95-a480-4289-b43b-4c740479bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:56.090106 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4df95-a480-4289-b43b-4c740479bb5f None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:56.090402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4df95-a480-4289-b43b-4c740479bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:56.090681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4df95-a480-4289-b43b-4c740479bb5f None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499/users/c16604b4fc634af2b77e187d65d67350/roles/69f0d114dbd94de3896c418607fa6e1a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:56.093338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4df95-a480-4289-b43b-4c740479bb5f None admin] RBAC: Authorizing `identity:create_grant(project_id=312f010075904c318a115286ea12a499, user_id=c16604b4fc634af2b77e187d65d67350, role_id=69f0d114dbd94de3896c418607fa6e1a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:56.095448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4df95-a480-4289-b43b-4c740479bb5f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:56.114961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 122/234] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:19:55 2022] PUT /identity/v3/projects/312f010075904c318a115286ea12a499/users/c16604b4fc634af2b77e187d65d67350/roles/69f0d114dbd94de3896c418607fa6e1a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:19:56.829469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9904-14cf-4027-9cab-b36d69e6b817 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:56.829874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9904-14cf-4027-9cab-b36d69e6b817 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:56.830104 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9904-14cf-4027-9cab-b36d69e6b817 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:56.831796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 113/235] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:56.848248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57e4fe-544e-4fd5-a8f5-205b78eb70aa None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:56.848752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57e4fe-544e-4fd5-a8f5-205b78eb70aa None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:56.848824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57e4fe-544e-4fd5-a8f5-205b78eb70aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:56.866141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-de57e4fe-544e-4fd5-a8f5-205b78eb70aa None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:56.867510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-de57e4fe-544e-4fd5-a8f5-205b78eb70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:56.962998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 123/236] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:56.998951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f9904-14cf-4027-9cab-b36d69e6b817 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:57.051473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594c0a-b29a-49b0-9579-0d557acfc41b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.051802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594c0a-b29a-49b0-9579-0d557acfc41b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.052046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594c0a-b29a-49b0-9579-0d557acfc41b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.055666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 124/237] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:57.068178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e3db-bc06-4ca6-9d3a-30569b49c60c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.068470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e3db-bc06-4ca6-9d3a-30569b49c60c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.068755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e3db-bc06-4ca6-9d3a-30569b49c60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.091811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0d10e3db-bc06-4ca6-9d3a-30569b49c60c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:57.093152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0d10e3db-bc06-4ca6-9d3a-30569b49c60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:57.187405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f9904-14cf-4027-9cab-b36d69e6b817 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:57.190413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 125/238] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:57.233810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaa289-0ea8-4a3a-b401-878275ddd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:57.234972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaa289-0ea8-4a3a-b401-878275ddd68e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.235484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaa289-0ea8-4a3a-b401-878275ddd68e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.235967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaa289-0ea8-4a3a-b401-878275ddd68e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.243419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e3db-bc06-4ca6-9d3a-30569b49c60c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:57.253416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:57.263772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaa289-0ea8-4a3a-b401-878275ddd68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-fafaa289-0ea8-4a3a-b401-878275ddd68e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:57.272470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:57.273364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:19:57.274122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:57.282796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 114/239] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:57.284054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaa289-0ea8-4a3a-b401-878275ddd68e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:57.291353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:57.353810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e3db-bc06-4ca6-9d3a-30569b49c60c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:57.390195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01ef8-569b-4729-9c54-944c94b51004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:57.391949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01ef8-569b-4729-9c54-944c94b51004 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.392300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01ef8-569b-4729-9c54-944c94b51004 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.392575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01ef8-569b-4729-9c54-944c94b51004 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.393777 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df01ef8-569b-4729-9c54-944c94b51004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:57.395771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df01ef8-569b-4729-9c54-944c94b51004 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:57.402054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 126/240] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:57.403284 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01ef8-569b-4729-9c54-944c94b51004 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:57.491207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaa289-0ea8-4a3a-b401-878275ddd68e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:57.511447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01ef8-569b-4729-9c54-944c94b51004 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:57.523368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:57.528238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:57.529574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.530073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.530559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.532505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:57.533168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:57.534971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:57.543990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 115/241] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:57.551033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8793c29-3a6b-4b3d-92e6-ccb280143103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:57.551502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8793c29-3a6b-4b3d-92e6-ccb280143103 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.551795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8793c29-3a6b-4b3d-92e6-ccb280143103 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.552078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8793c29-3a6b-4b3d-92e6-ccb280143103 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.552824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8793c29-3a6b-4b3d-92e6-ccb280143103 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:57.553167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:57.558815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8793c29-3a6b-4b3d-92e6-ccb280143103 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:57.604448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 127/242] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:19:57 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:19:57.626905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:57.674882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c2af-a998-486e-ab8a-77535b7eaa5a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:57.711915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ca382-f0fb-4550-b364-d43a029cab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:57.713207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca382-f0fb-4550-b364-d43a029cab11 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.713696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca382-f0fb-4550-b364-d43a029cab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.714176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ca382-f0fb-4550-b364-d43a029cab11 None admin] PATH_INFO: `/v3/users/7fc4486aea61491babc8c07d9b6153e5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.729621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ca382-f0fb-4550-b364-d43a029cab11 None admin] RBAC: Authorizing `identity:get_user(user_id=7fc4486aea61491babc8c07d9b6153e5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:57.731656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ca382-f0fb-4550-b364-d43a029cab11 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:57.733997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 116/243] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:57 2022] GET /identity/v3/users/7fc4486aea61491babc8c07d9b6153e5 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:57.740010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8793c29-3a6b-4b3d-92e6-ccb280143103 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:57.885431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8793c29-3a6b-4b3d-92e6-ccb280143103 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:57.925275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feaa56-fa6f-40d6-9942-2ad318a9c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:57.926291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feaa56-fa6f-40d6-9942-2ad318a9c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.926809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feaa56-fa6f-40d6-9942-2ad318a9c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.927293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feaa56-fa6f-40d6-9942-2ad318a9c9b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.961755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:57.974575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f6a51-49bc-4cf4-84a9-1ecf729fdcb4 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.975214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f6a51-49bc-4cf4-84a9-1ecf729fdcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.975714 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f6a51-49bc-4cf4-84a9-1ecf729fdcb4 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:57.977389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 117/244] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:19:57.988076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c73c6-13a7-4a9a-b08b-c6b4f2dcf93f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:57.988661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c73c6-13a7-4a9a-b08b-c6b4f2dcf93f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:57.989237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c73c6-13a7-4a9a-b08b-c6b4f2dcf93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.009122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feaa56-fa6f-40d6-9942-2ad318a9c9b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:58.010636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feaa56-fa6f-40d6-9942-2ad318a9c9b4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:58.018381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-bb0c73c6-13a7-4a9a-b08b-c6b4f2dcf93f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:58.020375 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-bb0c73c6-13a7-4a9a-b08b-c6b4f2dcf93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:58.114988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 128/245] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:19:58.120763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feaa56-fa6f-40d6-9942-2ad318a9c9b4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:58.124149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 118/246] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:58.151210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c73c6-13a7-4a9a-b08b-c6b4f2dcf93f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:58.212102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:58.222937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:58.257594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feaa56-fa6f-40d6-9942-2ad318a9c9b4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:58.283143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c73c6-13a7-4a9a-b08b-c6b4f2dcf93f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:58.295821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b069-8357-48f2-b78c-6510a193e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:58.296697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b069-8357-48f2-b78c-6510a193e7ea None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.296987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b069-8357-48f2-b78c-6510a193e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.297852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b069-8357-48f2-b78c-6510a193e7ea None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.300082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65b069-8357-48f2-b78c-6510a193e7ea None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:58.301299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65b069-8357-48f2-b78c-6510a193e7ea None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:58.303728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 129/247] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:58 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:58.309349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b069-8357-48f2-b78c-6510a193e7ea None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:58.322893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc3956-79ce-4e2e-ab05-7170419a998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:58.324088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc3956-79ce-4e2e-ab05-7170419a998a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.324642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc3956-79ce-4e2e-ab05-7170419a998a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.325211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc3956-79ce-4e2e-ab05-7170419a998a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.338343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc3956-79ce-4e2e-ab05-7170419a998a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-42fc3956-79ce-4e2e-ab05-7170419a998a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:58.347650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:58.348515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:19:58.349270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:58.352654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 119/248] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:58.358808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc3956-79ce-4e2e-ab05-7170419a998a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:58.421692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b069-8357-48f2-b78c-6510a193e7ea None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:58.451011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:58.457382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:58.458162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.462799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.462799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.462799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] RBAC: Adding query filter params (role.id=8ca1560f736e42cc82249ede008d9bc3, scope.project.id=312f010075904c318a115286ea12a499, user.id=7fc4486aea61491babc8c07d9b6153e5) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:58.462799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:58.462799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:58.468603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 130/249] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:19:58 2022] GET /identity/v3/role_assignments?user.id=7fc4486aea61491babc8c07d9b6153e5&scope.project.id=312f010075904c318a115286ea12a499&role.id=8ca1560f736e42cc82249ede008d9bc3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:19:58.499452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc3956-79ce-4e2e-ab05-7170419a998a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:58.514393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:58.545679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16cbf-1e47-486f-9aa4-cf373816ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:58.546383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16cbf-1e47-486f-9aa4-cf373816ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.546671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16cbf-1e47-486f-9aa4-cf373816ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.546986 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16cbf-1e47-486f-9aa4-cf373816ccb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.547813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16cbf-1e47-486f-9aa4-cf373816ccb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:58.548127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16cbf-1e47-486f-9aa4-cf373816ccb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:58.549576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16cbf-1e47-486f-9aa4-cf373816ccb7 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:58.559908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 120/250] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:19:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:58.565492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:58.667839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c072a-9515-4c37-8412-48dba9888f7d None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.668194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c072a-9515-4c37-8412-48dba9888f7d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.668489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c072a-9515-4c37-8412-48dba9888f7d None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.670913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 121/251] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:19:58.677093 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da61b-104b-4cae-877e-77b92e5b04a1 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.677337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da61b-104b-4cae-877e-77b92e5b04a1 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.677629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da61b-104b-4cae-877e-77b92e5b04a1 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.679272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 122/252] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:19:58.684695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f59746-01a2-4ade-b685-4a6cb67fbeef None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.684988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f59746-01a2-4ade-b685-4a6cb67fbeef None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.685277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f59746-01a2-4ade-b685-4a6cb67fbeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.694217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccde6d4-608c-44cd-9cbe-4726a1bc5240 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:58.720411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-15f59746-01a2-4ade-b685-4a6cb67fbeef None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:58.721701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-15f59746-01a2-4ade-b685-4a6cb67fbeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:58.730907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591203ff-c9d8-478c-9e25-883c0fb81628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:58.731796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591203ff-c9d8-478c-9e25-883c0fb81628 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.732081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591203ff-c9d8-478c-9e25-883c0fb81628 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.732357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591203ff-c9d8-478c-9e25-883c0fb81628 None admin] PATH_INFO: `/v3/users/1d1f467394e64952971d1d37c5066a8c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.733565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591203ff-c9d8-478c-9e25-883c0fb81628 None admin] RBAC: Authorizing `identity:get_user(user_id=1d1f467394e64952971d1d37c5066a8c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:58.735140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591203ff-c9d8-478c-9e25-883c0fb81628 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:58.737081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 131/253] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:58 2022] GET /identity/v3/users/1d1f467394e64952971d1d37c5066a8c => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:58.738391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728882a5-2cb2-4b0b-9d5c-778565b5ab71 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:58.738688 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728882a5-2cb2-4b0b-9d5c-778565b5ab71 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:58.738995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728882a5-2cb2-4b0b-9d5c-778565b5ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:58.756151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-728882a5-2cb2-4b0b-9d5c-778565b5ab71 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:19:58.757351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-728882a5-2cb2-4b0b-9d5c-778565b5ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:19:58.828102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 123/254] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:19:58.829594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f59746-01a2-4ade-b685-4a6cb67fbeef None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:58.834857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:58.865101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 132/255] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:19:58.865971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728882a5-2cb2-4b0b-9d5c-778565b5ab71 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:58.949553 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f59746-01a2-4ade-b685-4a6cb67fbeef None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:58.951788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:58.999684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d1f0c-4127-4103-9edd-1e75bc1eea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:59.001098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1f0c-4127-4103-9edd-1e75bc1eea26 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:59.001387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1f0c-4127-4103-9edd-1e75bc1eea26 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:59.001663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1f0c-4127-4103-9edd-1e75bc1eea26 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:59.003036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d1f0c-4127-4103-9edd-1e75bc1eea26 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:59.004642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d1f0c-4127-4103-9edd-1e75bc1eea26 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:59.006894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 124/256] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:19:58 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:59.012221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d1f0c-4127-4103-9edd-1e75bc1eea26 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:59.057980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728882a5-2cb2-4b0b-9d5c-778565b5ab71 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:59.095766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0e21-2b39-4ed6-bd49-d0705a5311b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:59.096930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0e21-2b39-4ed6-bd49-d0705a5311b0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:59.097442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0e21-2b39-4ed6-bd49-d0705a5311b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:59.097921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0e21-2b39-4ed6-bd49-d0705a5311b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:59.109049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff0e21-2b39-4ed6-bd49-d0705a5311b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-d3ff0e21-2b39-4ed6-bd49-d0705a5311b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:59.118247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:59.119368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:19:59.120135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:19:59.122382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 133/257] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:19:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:59.123445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0e21-2b39-4ed6-bd49-d0705a5311b0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:59.125082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d1f0c-4127-4103-9edd-1e75bc1eea26 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:59.175506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5011ae1-60df-4298-8ba7-1823d8edbb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:59.176785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011ae1-60df-4298-8ba7-1823d8edbb18 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:59.176785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011ae1-60df-4298-8ba7-1823d8edbb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:59.176998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011ae1-60df-4298-8ba7-1823d8edbb18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:59.196205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:59.207829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5011ae1-60df-4298-8ba7-1823d8edbb18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-e5011ae1-60df-4298-8ba7-1823d8edbb18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:19:59.219690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:19:59.220614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:19:59.221373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:19:59.231252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 125/258] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:19:59.232144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5011ae1-60df-4298-8ba7-1823d8edbb18 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:59.251522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0e21-2b39-4ed6-bd49-d0705a5311b0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:59.299255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:59.300570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2c53-793c-4aba-a58d-63e968d5c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:59.301754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2c53-793c-4aba-a58d-63e968d5c719 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:59.302248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2c53-793c-4aba-a58d-63e968d5c719 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:59.302693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2c53-793c-4aba-a58d-63e968d5c719 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499/users/1d1f467394e64952971d1d37c5066a8c/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:59.304920 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a2c53-793c-4aba-a58d-63e968d5c719 None admin] RBAC: Authorizing `identity:create_grant(project_id=312f010075904c318a115286ea12a499, user_id=1d1f467394e64952971d1d37c5066a8c, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:59.306576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a2c53-793c-4aba-a58d-63e968d5c719 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:59.329312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 134/259] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:19:59 2022] PUT /identity/v3/projects/312f010075904c318a115286ea12a499/users/1d1f467394e64952971d1d37c5066a8c/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:19:59.331055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2c53-793c-4aba-a58d-63e968d5c719 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:59.423325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5011ae1-60df-4298-8ba7-1823d8edbb18 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:59.496910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:59.497957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:59.498535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:59.499053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:59.500012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:59.500560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:59.502259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:59.512171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 126/260] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:19:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:59.520054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:59.545776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2c53-793c-4aba-a58d-63e968d5c719 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:59.573233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:59.651502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:59.652208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:59.652495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:59.652775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:59.653546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:19:59.654106 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:59.655551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:59.674740 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 135/261] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:59.681191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:59.693319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:19:59.713138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691082d-68f6-475f-a0c1-0e2f675ae403 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:59.784287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbb9fe-2aad-45e7-820e-282f3ca1e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:59.785098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb9fe-2aad-45e7-820e-282f3ca1e73b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:59.785382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb9fe-2aad-45e7-820e-282f3ca1e73b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:59.785661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbb9fe-2aad-45e7-820e-282f3ca1e73b None admin] PATH_INFO: `/v3/users/c16604b4fc634af2b77e187d65d67350` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:59.787476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbb9fe-2aad-45e7-820e-282f3ca1e73b None admin] RBAC: Authorizing `identity:get_user(user_id=c16604b4fc634af2b77e187d65d67350)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:59.788951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbb9fe-2aad-45e7-820e-282f3ca1e73b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:59.790584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 127/262] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:59 2022] GET /identity/v3/users/c16604b4fc634af2b77e187d65d67350 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:59.796707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbb9fe-2aad-45e7-820e-282f3ca1e73b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:19:59.866488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908038db-4c92-451c-a369-1f2e5787e426 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:59.934221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa7f74-9e44-4b1b-8b9b-5b94a1f66d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:19:59.935236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7f74-9e44-4b1b-8b9b-5b94a1f66d52 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:19:59.935527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7f74-9e44-4b1b-8b9b-5b94a1f66d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:19:59.935807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7f74-9e44-4b1b-8b9b-5b94a1f66d52 None admin] PATH_INFO: `/v3/users/c16604b4fc634af2b77e187d65d67350` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:19:59.939439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa7f74-9e44-4b1b-8b9b-5b94a1f66d52 None admin] RBAC: Authorizing `identity:get_user(user_id=c16604b4fc634af2b77e187d65d67350)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:19:59.941002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa7f74-9e44-4b1b-8b9b-5b94a1f66d52 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:19:59.943148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 136/263] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:19:59 2022] GET /identity/v3/users/c16604b4fc634af2b77e187d65d67350 => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:19:59.944383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbb9fe-2aad-45e7-820e-282f3ca1e73b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:19:59.956192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa7f74-9e44-4b1b-8b9b-5b94a1f66d52 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:00.011494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e2e8e-50b8-4597-ab1d-cea7aba0a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:00.012175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2e8e-50b8-4597-ab1d-cea7aba0a16a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:00.012469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2e8e-50b8-4597-ab1d-cea7aba0a16a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:00.012756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2e8e-50b8-4597-ab1d-cea7aba0a16a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:00.035190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:00.064450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:00.161230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e2e8e-50b8-4597-ab1d-cea7aba0a16a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:00.162792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e2e8e-50b8-4597-ab1d-cea7aba0a16a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:00.188706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa7f74-9e44-4b1b-8b9b-5b94a1f66d52 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:00.275833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d21b4d-42d4-4231-93df-4d953c0b48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:00.276552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21b4d-42d4-4231-93df-4d953c0b48ea None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:00.276836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21b4d-42d4-4231-93df-4d953c0b48ea None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:00.277119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d21b4d-42d4-4231-93df-4d953c0b48ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:00.379770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 128/264] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:00.385185 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e2e8e-50b8-4597-ab1d-cea7aba0a16a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:00.408612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d21b4d-42d4-4231-93df-4d953c0b48ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:00.411179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d21b4d-42d4-4231-93df-4d953c0b48ea None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:00.467601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:00.509648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:00.580485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 137/265] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:20:00.586587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d21b4d-42d4-4231-93df-4d953c0b48ea None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:00.587528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e2e8e-50b8-4597-ab1d-cea7aba0a16a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:00.640819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc722b0-a9a5-4d6b-90ab-50432ced8f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:00.641658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc722b0-a9a5-4d6b-90ab-50432ced8f9b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:00.641945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc722b0-a9a5-4d6b-90ab-50432ced8f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:00.642225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc722b0-a9a5-4d6b-90ab-50432ced8f9b None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:00.644043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc722b0-a9a5-4d6b-90ab-50432ced8f9b None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:00.645513 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc722b0-a9a5-4d6b-90ab-50432ced8f9b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:00.647258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 129/266] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:00 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:00.654548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc722b0-a9a5-4d6b-90ab-50432ced8f9b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:00.800244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d21b4d-42d4-4231-93df-4d953c0b48ea None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:00.841970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc722b0-a9a5-4d6b-90ab-50432ced8f9b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:00.863508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e516-a7df-4160-b38b-a3eb63bbebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:00.864772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e516-a7df-4160-b38b-a3eb63bbebd1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:00.865273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e516-a7df-4160-b38b-a3eb63bbebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:00.865746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e516-a7df-4160-b38b-a3eb63bbebd1 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:00.870068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3e516-a7df-4160-b38b-a3eb63bbebd1 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:00.871761 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3e516-a7df-4160-b38b-a3eb63bbebd1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:00.873717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 138/267] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:00 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:00.880079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e516-a7df-4160-b38b-a3eb63bbebd1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:00.903172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:00.906825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:00.917764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70b62d-15bb-4535-b08c-e508b825b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:00.917764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70b62d-15bb-4535-b08c-e508b825b239 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:00.917764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70b62d-15bb-4535-b08c-e508b825b239 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:00.917764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70b62d-15bb-4535-b08c-e508b825b239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:00.918145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70b62d-15bb-4535-b08c-e508b825b239 None admin] RBAC: Adding query filter params (role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=312f010075904c318a115286ea12a499, user.id=c16604b4fc634af2b77e187d65d67350) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:00.918145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70b62d-15bb-4535-b08c-e508b825b239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:00.919358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70b62d-15bb-4535-b08c-e508b825b239 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:00.934282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 130/268] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:00 2022] GET /identity/v3/role_assignments?user.id=c16604b4fc634af2b77e187d65d67350&scope.project.id=312f010075904c318a115286ea12a499&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:00.997010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967243f3-15d6-4c05-99f3-efe0972f4e19 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:00.997324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967243f3-15d6-4c05-99f3-efe0972f4e19 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:00.997578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967243f3-15d6-4c05-99f3-efe0972f4e19 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:00.999007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 131/269] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:01.004284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c5cef-0dff-4b83-8a7f-db95aaa46659 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.004576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c5cef-0dff-4b83-8a7f-db95aaa46659 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.004860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c5cef-0dff-4b83-8a7f-db95aaa46659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.038759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a75c5cef-0dff-4b83-8a7f-db95aaa46659 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:01.039999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a75c5cef-0dff-4b83-8a7f-db95aaa46659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:01.059198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e516-a7df-4160-b38b-a3eb63bbebd1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:01.105006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb302b2a-45da-4810-ae39-a5fa7667df39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:01.105677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302b2a-45da-4810-ae39-a5fa7667df39 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.105965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302b2a-45da-4810-ae39-a5fa7667df39 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.106243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302b2a-45da-4810-ae39-a5fa7667df39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.107268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb302b2a-45da-4810-ae39-a5fa7667df39 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=312f010075904c318a115286ea12a499, user.id=c16604b4fc634af2b77e187d65d67350) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:01.107583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb302b2a-45da-4810-ae39-a5fa7667df39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:01.109321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb302b2a-45da-4810-ae39-a5fa7667df39 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:01.117846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 139/270] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:00 2022] GET /identity/v3/role_assignments?user.id=c16604b4fc634af2b77e187d65d67350&scope.project.id=312f010075904c318a115286ea12a499&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:01.119389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5273ec-d067-4e4b-acbe-1d626f9006f0 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.119679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5273ec-d067-4e4b-acbe-1d626f9006f0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.119967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5273ec-d067-4e4b-acbe-1d626f9006f0 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.121923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 140/271] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:01.130047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931e09a-ea72-4b19-a188-1b36235e7b7c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.130381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931e09a-ea72-4b19-a188-1b36235e7b7c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.130620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931e09a-ea72-4b19-a188-1b36235e7b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.137917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 132/272] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:01.164525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1931e09a-ea72-4b19-a188-1b36235e7b7c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:01.165894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1931e09a-ea72-4b19-a188-1b36235e7b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:01.229419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c5cef-0dff-4b83-8a7f-db95aaa46659 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:01.269435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 141/273] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:01.294816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931e09a-ea72-4b19-a188-1b36235e7b7c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:01.323974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:01.413726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931e09a-ea72-4b19-a188-1b36235e7b7c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:01.461456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dbc15-f51a-4bc9-8627-dd0dda5ffaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:01.462199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbc15-f51a-4bc9-8627-dd0dda5ffaef None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.462487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbc15-f51a-4bc9-8627-dd0dda5ffaef None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.462795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbc15-f51a-4bc9-8627-dd0dda5ffaef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.471001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c5cef-0dff-4b83-8a7f-db95aaa46659 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:01.476525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dbc15-f51a-4bc9-8627-dd0dda5ffaef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ad6dbc15-f51a-4bc9-8627-dd0dda5ffaef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:01.486361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:01.487265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:01.488033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 142/274] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:01.490833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0a0c2-f78d-4429-a7ad-5161a2ab115b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.491110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0a0c2-f78d-4429-a7ad-5161a2ab115b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.491397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0a0c2-f78d-4429-a7ad-5161a2ab115b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.494800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 143/275] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:01.494800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0a0c2-f78d-4429-a7ad-5161a2ab115b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:01.504463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:01.533689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46b32-8ead-4855-84a4-dc16a8538cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:01.533689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46b32-8ead-4855-84a4-dc16a8538cdf None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.533689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46b32-8ead-4855-84a4-dc16a8538cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.533689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46b32-8ead-4855-84a4-dc16a8538cdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.535183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46b32-8ead-4855-84a4-dc16a8538cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:01.537227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46b32-8ead-4855-84a4-dc16a8538cdf None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:01.539187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 133/276] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:01.540267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b27f-dc3d-4791-b409-cd37021ff0de None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.540563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b27f-dc3d-4791-b409-cd37021ff0de None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.540964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b27f-dc3d-4791-b409-cd37021ff0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.559340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a9c4b27f-dc3d-4791-b409-cd37021ff0de None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:01.560530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a9c4b27f-dc3d-4791-b409-cd37021ff0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:01.578092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:01.620079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0a0c2-f78d-4429-a7ad-5161a2ab115b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:01.635741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 134/277] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:01.636462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4b27f-dc3d-4791-b409-cd37021ff0de None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:01.670257 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:01.670969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.671261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.671709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.673258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:01.673581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:01.674998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:01.683804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 144/278] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:01.684685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:01.743096 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4b27f-dc3d-4791-b409-cd37021ff0de None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:01.760993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:01.778690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf17c-bc2c-43c2-bb8c-3e8faefd7460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:01.779656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf17c-bc2c-43c2-bb8c-3e8faefd7460 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.779940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf17c-bc2c-43c2-bb8c-3e8faefd7460 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.780220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf17c-bc2c-43c2-bb8c-3e8faefd7460 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.780925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf17c-bc2c-43c2-bb8c-3e8faefd7460 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:01.782430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf17c-bc2c-43c2-bb8c-3e8faefd7460 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:01.791864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed97c68-33d7-4b76-bb31-0c7c851fd2ce None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:01.804232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 135/279] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:01 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:01.805335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf17c-bc2c-43c2-bb8c-3e8faefd7460 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:01.821101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:01.832539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f831c-b458-4b87-a903-992e0477f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:01.833631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f831c-b458-4b87-a903-992e0477f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:01.834073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f831c-b458-4b87-a903-992e0477f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:01.834361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f831c-b458-4b87-a903-992e0477f4e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:01.846801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f831c-b458-4b87-a903-992e0477f4e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-583f831c-b458-4b87-a903-992e0477f4e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:01.855038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:01.856185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:01.857132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:01.861893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 145/280] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:01.862643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f831c-b458-4b87-a903-992e0477f4e6 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:01.968819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf17c-bc2c-43c2-bb8c-3e8faefd7460 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:01.978390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f831c-b458-4b87-a903-992e0477f4e6 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:02.017590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75bd2-6ec2-4d73-9ed7-b9cfdae4e251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:02.018572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:02.018821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75bd2-6ec2-4d73-9ed7-b9cfdae4e251 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.019072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75bd2-6ec2-4d73-9ed7-b9cfdae4e251 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.019283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.019438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75bd2-6ec2-4d73-9ed7-b9cfdae4e251 None admin] PATH_INFO: `/v3/users/7fc4486aea61491babc8c07d9b6153e5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.019588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.019841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.020626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:02.020732 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e75bd2-6ec2-4d73-9ed7-b9cfdae4e251 None admin] RBAC: Authorizing `identity:get_user(user_id=7fc4486aea61491babc8c07d9b6153e5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:02.020939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:02.022146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e75bd2-6ec2-4d73-9ed7-b9cfdae4e251 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:02.022301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:02.024340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 136/281] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:01 2022] GET /identity/v3/users/7fc4486aea61491babc8c07d9b6153e5 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:02.030074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75bd2-6ec2-4d73-9ed7-b9cfdae4e251 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:02.036789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 146/282] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:02.043186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:02.085176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:02.106793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:02.153552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75bd2-6ec2-4d73-9ed7-b9cfdae4e251 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:02.173462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a37a8f-6401-4364-8851-cfb5dfa8b173 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:02.195864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74449e50-2905-41eb-9894-522e9498f6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:02.196746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449e50-2905-41eb-9894-522e9498f6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.197034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449e50-2905-41eb-9894-522e9498f6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.197316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449e50-2905-41eb-9894-522e9498f6c9 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.199866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74449e50-2905-41eb-9894-522e9498f6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:02.202036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74449e50-2905-41eb-9894-522e9498f6c9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:02.204298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 137/283] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:02 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:02.210446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74449e50-2905-41eb-9894-522e9498f6c9 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:02.224046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5de0ff-971d-4de1-b5a5-c1a2e7349e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:02.224968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5de0ff-971d-4de1-b5a5-c1a2e7349e22 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.225553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5de0ff-971d-4de1-b5a5-c1a2e7349e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.225855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5de0ff-971d-4de1-b5a5-c1a2e7349e22 None admin] PATH_INFO: `/v3/users/b093aed76dd2471391de585504881ccb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.247762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5de0ff-971d-4de1-b5a5-c1a2e7349e22 None admin] RBAC: Authorizing `identity:get_user(user_id=b093aed76dd2471391de585504881ccb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:02.250550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5de0ff-971d-4de1-b5a5-c1a2e7349e22 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:02.256053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 147/284] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:02 2022] GET /identity/v3/users/b093aed76dd2471391de585504881ccb => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:02.261492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5de0ff-971d-4de1-b5a5-c1a2e7349e22 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:02.336632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74449e50-2905-41eb-9894-522e9498f6c9 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:02.351236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:02.372692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5de0ff-971d-4de1-b5a5-c1a2e7349e22 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:02.383224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03be4d1-5e64-438a-bda6-2d7cab51e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:02.384821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03be4d1-5e64-438a-bda6-2d7cab51e809 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.385397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03be4d1-5e64-438a-bda6-2d7cab51e809 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.385857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03be4d1-5e64-438a-bda6-2d7cab51e809 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499/users/7fc4486aea61491babc8c07d9b6153e5/roles/8ca1560f736e42cc82249ede008d9bc3` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.388897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03be4d1-5e64-438a-bda6-2d7cab51e809 None admin] RBAC: Authorizing `identity:create_grant(project_id=312f010075904c318a115286ea12a499, user_id=7fc4486aea61491babc8c07d9b6153e5, role_id=8ca1560f736e42cc82249ede008d9bc3)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:02.391069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03be4d1-5e64-438a-bda6-2d7cab51e809 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:02.391215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:02.409313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 138/285] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:02 2022] PUT /identity/v3/projects/312f010075904c318a115286ea12a499/users/7fc4486aea61491babc8c07d9b6153e5/roles/8ca1560f736e42cc82249ede008d9bc3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:20:02.409858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:02.410737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.411117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.411474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.411937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfffa-e853-4fac-93d2-3784178e0438 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.412405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfffa-e853-4fac-93d2-3784178e0438 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.412507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] RBAC: Adding query filter params (role.id=36219e61b6d84e06b7585b5dca9f1c95, user.id=b093aed76dd2471391de585504881ccb, scope.system=all) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:02.412910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:02.413165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cfffa-e853-4fac-93d2-3784178e0438 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.414543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:02.415039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 139/286] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:02.427007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d943327-bf3f-4f20-b807-59132c7e75ec None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.427007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d943327-bf3f-4f20-b807-59132c7e75ec None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.427007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d943327-bf3f-4f20-b807-59132c7e75ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.430227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 148/287] 10.222.0.72 () {56 vars in 1308 bytes} [Tue Jul 12 14:20:02 2022] GET /identity/v3/role_assignments?user.id=b093aed76dd2471391de585504881ccb&scope.system=all&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:02.448110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4d943327-bf3f-4f20-b807-59132c7e75ec None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:02.449492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4d943327-bf3f-4f20-b807-59132c7e75ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:02.544971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 140/288] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:02.583277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:02.697856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42757441-e81f-4460-a2ec-e07f8c116c72 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:02.731842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00f1a-c175-4926-ad0f-1078828523cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:02.732650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00f1a-c175-4926-ad0f-1078828523cb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.732935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00f1a-c175-4926-ad0f-1078828523cb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.733274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00f1a-c175-4926-ad0f-1078828523cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.746458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d00f1a-c175-4926-ad0f-1078828523cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b2d00f1a-c175-4926-ad0f-1078828523cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:02.754384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:02.755305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:02.756076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 149/289] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:02.761567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d943327-bf3f-4f20-b807-59132c7e75ec None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:02.908675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:02.913038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d943327-bf3f-4f20-b807-59132c7e75ec None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:02.976185 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:02.976792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:02.977076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:02.977352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:02.978111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:02.978420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:02.979895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:02.994588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 141/290] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:03.000018 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00f1a-c175-4926-ad0f-1078828523cb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:03.066938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:03.140613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00f1a-c175-4926-ad0f-1078828523cb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:03.177463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8657c-7979-4bbf-b63d-96eb0990ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:03.178397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8657c-7979-4bbf-b63d-96eb0990ca6a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:03.178723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8657c-7979-4bbf-b63d-96eb0990ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:03.179027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8657c-7979-4bbf-b63d-96eb0990ca6a None admin] PATH_INFO: `/v3/users/1d1f467394e64952971d1d37c5066a8c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:03.180222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8657c-7979-4bbf-b63d-96eb0990ca6a None admin] RBAC: Authorizing `identity:get_user(user_id=1d1f467394e64952971d1d37c5066a8c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:03.181658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8657c-7979-4bbf-b63d-96eb0990ca6a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:03.183312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 150/291] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:02 2022] GET /identity/v3/users/1d1f467394e64952971d1d37c5066a8c => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:03.188874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:03.342545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f9b79-e812-4b07-8a1b-e6a6471bf9df None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:03.387625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be558aa-e306-4a54-b510-8a710c154926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:03.388289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be558aa-e306-4a54-b510-8a710c154926 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:03.388576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be558aa-e306-4a54-b510-8a710c154926 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:03.388852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be558aa-e306-4a54-b510-8a710c154926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:03.431519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:03.485300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be558aa-e306-4a54-b510-8a710c154926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:03.486780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be558aa-e306-4a54-b510-8a710c154926 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:03.623444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 142/292] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:03.629477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8657c-7979-4bbf-b63d-96eb0990ca6a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:03.773005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:03.777374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8657c-7979-4bbf-b63d-96eb0990ca6a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:03.821811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be049ede-f2da-49e6-856a-dbd0fa5cb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:03.822689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049ede-f2da-49e6-856a-dbd0fa5cb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:03.823068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049ede-f2da-49e6-856a-dbd0fa5cb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:03.823360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be049ede-f2da-49e6-856a-dbd0fa5cb3e6 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:03.824558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be049ede-f2da-49e6-856a-dbd0fa5cb3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:03.826069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be049ede-f2da-49e6-856a-dbd0fa5cb3e6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:03.827803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 151/293] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:03 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:03.834390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be558aa-e306-4a54-b510-8a710c154926 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:03.927852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:03.984676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be558aa-e306-4a54-b510-8a710c154926 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:04.040713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeaa1a-828d-4b84-b48a-6f2207406e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:04.041415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeaa1a-828d-4b84-b48a-6f2207406e65 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.041703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeaa1a-828d-4b84-b48a-6f2207406e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.041982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeaa1a-828d-4b84-b48a-6f2207406e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.042852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeaa1a-828d-4b84-b48a-6f2207406e65 None admin] RBAC: Adding query filter params (role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=312f010075904c318a115286ea12a499, user.id=1d1f467394e64952971d1d37c5066a8c) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:04.043177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeaa1a-828d-4b84-b48a-6f2207406e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:04.044658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeaa1a-828d-4b84-b48a-6f2207406e65 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:04.055597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 143/294] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:03 2022] GET /identity/v3/role_assignments?user.id=1d1f467394e64952971d1d37c5066a8c&scope.project.id=312f010075904c318a115286ea12a499&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:04.489747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34885-5401-4989-a05c-f7afdebd55da None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.490111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34885-5401-4989-a05c-f7afdebd55da None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.490326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34885-5401-4989-a05c-f7afdebd55da None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.492050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 152/295] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:04.497283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee474-a410-4139-8d57-2316cefda64a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.497745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee474-a410-4139-8d57-2316cefda64a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.497919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ee474-a410-4139-8d57-2316cefda64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.515481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-451ee474-a410-4139-8d57-2316cefda64a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:04.517233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-451ee474-a410-4139-8d57-2316cefda64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:04.606682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 144/296] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:04.630531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a34885-5401-4989-a05c-f7afdebd55da None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:04.659813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d797b5-14fd-4a1c-ad9b-7943447b2f0f None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.660176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d797b5-14fd-4a1c-ad9b-7943447b2f0f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.660464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d797b5-14fd-4a1c-ad9b-7943447b2f0f None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.662912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 145/297] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:04.669369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d3f4-bd98-4492-ab2f-7eafdcc2e66e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.669802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d3f4-bd98-4492-ab2f-7eafdcc2e66e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.670236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d3f4-bd98-4492-ab2f-7eafdcc2e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.694230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b0c0d3f4-bd98-4492-ab2f-7eafdcc2e66e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:04.695483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b0c0d3f4-bd98-4492-ab2f-7eafdcc2e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:04.742651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a34885-5401-4989-a05c-f7afdebd55da None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:04.751194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:04.770067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 146/298] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:04.778960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9d5cc-a13c-43ec-a364-54e740065fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:04.780024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9d5cc-a13c-43ec-a364-54e740065fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.780314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9d5cc-a13c-43ec-a364-54e740065fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.780596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9d5cc-a13c-43ec-a364-54e740065fd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.791248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9d5cc-a13c-43ec-a364-54e740065fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:04.793276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0d3f4-bd98-4492-ab2f-7eafdcc2e66e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-f0f9d5cc-a13c-43ec-a364-54e740065fd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:04.799505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:04.801508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:04.803414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 153/299] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:04.810794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9d5cc-a13c-43ec-a364-54e740065fd0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:04.859181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:04.916000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0d3f4-bd98-4492-ab2f-7eafdcc2e66e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:04.921321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9d5cc-a13c-43ec-a364-54e740065fd0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:04.956635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9cc9d-c390-4c2f-ab87-30fa41df57b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:04.957553 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9cc9d-c390-4c2f-ab87-30fa41df57b3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.957893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9cc9d-c390-4c2f-ab87-30fa41df57b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.958172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9cc9d-c390-4c2f-ab87-30fa41df57b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.959387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9cc9d-c390-4c2f-ab87-30fa41df57b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:04.959797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88f8da-b307-4e2b-ac50-22d4bb613a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:04.960475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f8da-b307-4e2b-ac50-22d4bb613a8a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.960762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f8da-b307-4e2b-ac50-22d4bb613a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.960861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9cc9d-c390-4c2f-ab87-30fa41df57b3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:04.961043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f8da-b307-4e2b-ac50-22d4bb613a8a None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.961792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88f8da-b307-4e2b-ac50-22d4bb613a8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:04.962098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88f8da-b307-4e2b-ac50-22d4bb613a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:04.962664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 147/300] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:04.963674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbb52a-0cd3-440a-87ce-1191e87e08a2 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.963965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbb52a-0cd3-440a-87ce-1191e87e08a2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.964244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbb52a-0cd3-440a-87ce-1191e87e08a2 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.965906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 148/301] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:04.968099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88f8da-b307-4e2b-ac50-22d4bb613a8a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:04.971157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbb52a-0cd3-440a-87ce-1191e87e08a2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:04.982491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 154/302] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:04.982491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318e444-bdd7-4745-8a4a-53a456ccef79 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:04.982491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318e444-bdd7-4745-8a4a-53a456ccef79 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:04.982491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318e444-bdd7-4745-8a4a-53a456ccef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:04.997899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7318e444-bdd7-4745-8a4a-53a456ccef79 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:04.999042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7318e444-bdd7-4745-8a4a-53a456ccef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:05.030289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:05.071594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 155/303] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:05.072450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318e444-bdd7-4745-8a4a-53a456ccef79 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:05.091894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:05.092783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbb52a-0cd3-440a-87ce-1191e87e08a2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.127696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbaf15-5173-4a92-866b-1fe3b4929a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.128364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbaf15-5173-4a92-866b-1fe3b4929a9f None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.128654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbaf15-5173-4a92-866b-1fe3b4929a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.128930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbaf15-5173-4a92-866b-1fe3b4929a9f None admin] PATH_INFO: `/v3/groups` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.129619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbaf15-5173-4a92-866b-1fe3b4929a9f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:05.131086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbaf15-5173-4a92-866b-1fe3b4929a9f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:05.146583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 149/304] 10.222.0.72 () {60 vars in 1134 bytes} [Tue Jul 12 14:20:04 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:05.148022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f583-dd16-4f1a-817a-6719a3cb16c8 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.148320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f583-dd16-4f1a-817a-6719a3cb16c8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.148600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96f583-dd16-4f1a-817a-6719a3cb16c8 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.149856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 150/305] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:05.150575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f583-dd16-4f1a-817a-6719a3cb16c8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:05.187982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318e444-bdd7-4745-8a4a-53a456ccef79 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.227526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e599d20-15d2-4ec4-a9cd-4091872df06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.228444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599d20-15d2-4ec4-a9cd-4091872df06b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.228730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599d20-15d2-4ec4-a9cd-4091872df06b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.229012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599d20-15d2-4ec4-a9cd-4091872df06b None admin] PATH_INFO: `/v3/users/1e6189b7eafe41498ab9ee5ff6f34779` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.245799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e599d20-15d2-4ec4-a9cd-4091872df06b None admin] RBAC: Authorizing `identity:get_user(user_id=1e6189b7eafe41498ab9ee5ff6f34779)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:05.247336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e599d20-15d2-4ec4-a9cd-4091872df06b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:05.254387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 156/306] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:05 2022] GET /identity/v3/users/1e6189b7eafe41498ab9ee5ff6f34779 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:05.254387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7a92-a958-447b-93d7-c8cb10bbcfc9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.254387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7a92-a958-447b-93d7-c8cb10bbcfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.254387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7a92-a958-447b-93d7-c8cb10bbcfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.268492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-610e7a92-a958-447b-93d7-c8cb10bbcfc9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:05.269720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-610e7a92-a958-447b-93d7-c8cb10bbcfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:05.282898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96f583-dd16-4f1a-817a-6719a3cb16c8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.298482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:05.327228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefb5bf-c513-4639-871a-5fc1f501f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.328096 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb5bf-c513-4639-871a-5fc1f501f08f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.328376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb5bf-c513-4639-871a-5fc1f501f08f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.329480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb5bf-c513-4639-871a-5fc1f501f08f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.340839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefb5bf-c513-4639-871a-5fc1f501f08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:05.346056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 157/307] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:05.347012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e7a92-a958-447b-93d7-c8cb10bbcfc9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-bdefb5bf-c513-4639-871a-5fc1f501f08f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:05.348808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:05.349650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:05.350432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 151/308] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:05.355887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefb5bf-c513-4639-871a-5fc1f501f08f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:05.360907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:05.461602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e7a92-a958-447b-93d7-c8cb10bbcfc9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.465251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefb5bf-c513-4639-871a-5fc1f501f08f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.497854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.498523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.498835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.499121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.499958 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] RBAC: Adding query filter params (role.id=8ca1560f736e42cc82249ede008d9bc3, user.id=1e6189b7eafe41498ab9ee5ff6f34779, scope.system=all) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:05.500299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:05.501786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:05.503777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.505021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.505469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.505750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.506510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:05.506853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:05.515133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 158/309] 10.222.0.72 () {56 vars in 1308 bytes} [Tue Jul 12 14:20:05 2022] GET /identity/v3/role_assignments?user.id=1e6189b7eafe41498ab9ee5ff6f34779&scope.system=all&role.id=8ca1560f736e42cc82249ede008d9bc3 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:05.515133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:05.515403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:05.523886 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 152/310] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:05.529888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:05.577748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:05.603534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:05.646068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4501-7f4b-4542-b81b-b02915090bae None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.666452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36faab-acfb-4ab2-8d40-13a5ff05d4d5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.688452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c688-789d-4e8f-a000-34fcb219e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.689120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c688-789d-4e8f-a000-34fcb219e928 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.689497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c688-789d-4e8f-a000-34fcb219e928 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.689787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c688-789d-4e8f-a000-34fcb219e928 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.703946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63c688-789d-4e8f-a000-34fcb219e928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:05.711799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f4210-ffde-44ff-943b-4861af61fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5d63c688-789d-4e8f-a000-34fcb219e928 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:05.712353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:05.713171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:05.713948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:05.714565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f4210-ffde-44ff-943b-4861af61fb25 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.714565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f4210-ffde-44ff-943b-4861af61fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.714565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f4210-ffde-44ff-943b-4861af61fb25 None admin] PATH_INFO: `/v3/users/b093aed76dd2471391de585504881ccb` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.714735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 159/311] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:05.714874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f4210-ffde-44ff-943b-4861af61fb25 None admin] RBAC: Authorizing `identity:get_user(user_id=b093aed76dd2471391de585504881ccb)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:05.715899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f4210-ffde-44ff-943b-4861af61fb25 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:05.722459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 153/312] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:05 2022] GET /identity/v3/users/b093aed76dd2471391de585504881ccb => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:05.723618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c688-789d-4e8f-a000-34fcb219e928 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:05.723759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f4210-ffde-44ff-943b-4861af61fb25 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:05.833230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f4210-ffde-44ff-943b-4861af61fb25 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.836887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:05.859192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c688-789d-4e8f-a000-34fcb219e928 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:05.874823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca88a7-895d-44bb-a88b-1b61e02c0e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.876000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca88a7-895d-44bb-a88b-1b61e02c0e7f None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.876501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca88a7-895d-44bb-a88b-1b61e02c0e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.876784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca88a7-895d-44bb-a88b-1b61e02c0e7f None admin] PATH_INFO: `/v3/system/users/b093aed76dd2471391de585504881ccb/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.878308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca88a7-895d-44bb-a88b-1b61e02c0e7f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b093aed76dd2471391de585504881ccb, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:05.879748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca88a7-895d-44bb-a88b-1b61e02c0e7f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:05.895602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 154/313] 10.222.0.72 () {58 vars in 1334 bytes} [Tue Jul 12 14:20:05 2022] PUT /identity/v3/system/users/b093aed76dd2471391de585504881ccb/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:05.896597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:05.906341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:05.908074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:05.908608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:05.909183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:05.910317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:05.910919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:05.912636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:05.928284 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 160/314] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:05.930174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca88a7-895d-44bb-a88b-1b61e02c0e7f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:06.049110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca88a7-895d-44bb-a88b-1b61e02c0e7f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:06.085333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b5a6f-4ddb-4dd6-a031-b7f1e781fb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:06.086158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5a6f-4ddb-4dd6-a031-b7f1e781fb2e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:06.086448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5a6f-4ddb-4dd6-a031-b7f1e781fb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:06.086733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b5a6f-4ddb-4dd6-a031-b7f1e781fb2e None admin] PATH_INFO: `/v3/users/7fc4486aea61491babc8c07d9b6153e5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:06.087961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b5a6f-4ddb-4dd6-a031-b7f1e781fb2e None admin] RBAC: Authorizing `identity:get_user(user_id=7fc4486aea61491babc8c07d9b6153e5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:06.089427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b5a6f-4ddb-4dd6-a031-b7f1e781fb2e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:06.091468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 155/315] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:05 2022] GET /identity/v3/users/7fc4486aea61491babc8c07d9b6153e5 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:06.097488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:06.207352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872a5e7-bc0b-41f9-a9a8-a4366bff131f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:06.244383 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b6de1-6710-4d98-b498-85c7d4451d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:06.245417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6de1-6710-4d98-b498-85c7d4451d78 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:06.245912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6de1-6710-4d98-b498-85c7d4451d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:06.246399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6de1-6710-4d98-b498-85c7d4451d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:06.310582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:06.321692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b6de1-6710-4d98-b498-85c7d4451d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:06.323465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b6de1-6710-4d98-b498-85c7d4451d78 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:06.428900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 161/316] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:06.434386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b5a6f-4ddb-4dd6-a031-b7f1e781fb2e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:06.472277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:06.540524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b5a6f-4ddb-4dd6-a031-b7f1e781fb2e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:06.576303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661da92d-3b0c-42c9-a2d1-a9635dff9067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:06.577516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661da92d-3b0c-42c9-a2d1-a9635dff9067 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:06.578003 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661da92d-3b0c-42c9-a2d1-a9635dff9067 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:06.578487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661da92d-3b0c-42c9-a2d1-a9635dff9067 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:06.580473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661da92d-3b0c-42c9-a2d1-a9635dff9067 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:06.582126 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661da92d-3b0c-42c9-a2d1-a9635dff9067 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:06.588839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 156/317] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:06 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:06.590425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b6de1-6710-4d98-b498-85c7d4451d78 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:06.687111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:06.699902 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b6de1-6710-4d98-b498-85c7d4451d78 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:06.736411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051772e-2611-4583-9226-7c35c6da5d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:06.737409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051772e-2611-4583-9226-7c35c6da5d3a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:06.737895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051772e-2611-4583-9226-7c35c6da5d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:06.738437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051772e-2611-4583-9226-7c35c6da5d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:06.739522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051772e-2611-4583-9226-7c35c6da5d3a None admin] RBAC: Adding query filter params (role.id=8ca1560f736e42cc82249ede008d9bc3, scope.project.id=312f010075904c318a115286ea12a499, user.id=7fc4486aea61491babc8c07d9b6153e5) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:06.740042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051772e-2611-4583-9226-7c35c6da5d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:06.741691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051772e-2611-4583-9226-7c35c6da5d3a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:06.754906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 162/318] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:06 2022] GET /identity/v3/role_assignments?user.id=7fc4486aea61491babc8c07d9b6153e5&scope.project.id=312f010075904c318a115286ea12a499&role.id=8ca1560f736e42cc82249ede008d9bc3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:07.281760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdbb91-7c76-434f-824a-01c3058cd632 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:07.282650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdbb91-7c76-434f-824a-01c3058cd632 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:07.282869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdbb91-7c76-434f-824a-01c3058cd632 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:07.284386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 157/319] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:07.289438 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fafef-ad47-4b76-ac49-7e4694882246 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:07.289808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fafef-ad47-4b76-ac49-7e4694882246 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:07.290163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fafef-ad47-4b76-ac49-7e4694882246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:07.307495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-8f0fafef-ad47-4b76-ac49-7e4694882246 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:07.308689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8f0fafef-ad47-4b76-ac49-7e4694882246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:07.378892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 163/320] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:07.399800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdbb91-7c76-434f-824a-01c3058cd632 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:07.504937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdbb91-7c76-434f-824a-01c3058cd632 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:07.507241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:07.541122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc9289-18ab-49a2-ba73-f4c22504015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:07.541927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc9289-18ab-49a2-ba73-f4c22504015b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:07.542215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc9289-18ab-49a2-ba73-f4c22504015b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:07.542492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc9289-18ab-49a2-ba73-f4c22504015b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:07.543681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc9289-18ab-49a2-ba73-f4c22504015b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:07.545139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc9289-18ab-49a2-ba73-f4c22504015b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:07.546928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 158/321] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:07.552401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fafef-ad47-4b76-ac49-7e4694882246 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:07.589339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a4f24-b8c2-4e2c-9cfa-383335242c05 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:07.589648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a4f24-b8c2-4e2c-9cfa-383335242c05 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:07.589909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a4f24-b8c2-4e2c-9cfa-383335242c05 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:07.591434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 159/322] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:07.597224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a37d-a056-4372-8ab4-0063be7d28d7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:07.597516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a37d-a056-4372-8ab4-0063be7d28d7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:07.597950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a37d-a056-4372-8ab4-0063be7d28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:07.614259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d3a9a37d-a056-4372-8ab4-0063be7d28d7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:07.615475 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d3a9a37d-a056-4372-8ab4-0063be7d28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:07.638864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:07.656291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fafef-ad47-4b76-ac49-7e4694882246 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:07.688827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 160/323] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:07.692448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c7f5-dd7b-46d8-80bf-12fc0e9807b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:07.693712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c7f5-dd7b-46d8-80bf-12fc0e9807b8 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:07.694294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c7f5-dd7b-46d8-80bf-12fc0e9807b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:07.694805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c7f5-dd7b-46d8-80bf-12fc0e9807b8 None admin] PATH_INFO: `/v3/groups` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:07.695708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c7f5-dd7b-46d8-80bf-12fc0e9807b8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:07.697332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c7f5-dd7b-46d8-80bf-12fc0e9807b8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:07.711531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9a37d-a056-4372-8ab4-0063be7d28d7 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:07.714246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 164/324] 10.222.0.72 () {60 vars in 1134 bytes} [Tue Jul 12 14:20:07 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:07.826336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9a37d-a056-4372-8ab4-0063be7d28d7 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:07.827996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:07.866821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b2d00-dc8f-43c7-a61f-9dbd396e6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:07.866821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b2d00-dc8f-43c7-a61f-9dbd396e6376 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:07.866821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b2d00-dc8f-43c7-a61f-9dbd396e6376 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:07.867131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b2d00-dc8f-43c7-a61f-9dbd396e6376 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:07.879517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b2d00-dc8f-43c7-a61f-9dbd396e6376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-a62b2d00-dc8f-43c7-a61f-9dbd396e6376 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:07.887491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:07.888343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:07.889163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 161/325] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:07.895478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c7f5-dd7b-46d8-80bf-12fc0e9807b8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:08.012741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c7f5-dd7b-46d8-80bf-12fc0e9807b8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:08.015219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf3b1-912b-4aa5-941d-209ad72cc75e None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.015512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf3b1-912b-4aa5-941d-209ad72cc75e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.015790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf3b1-912b-4aa5-941d-209ad72cc75e None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.017912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 162/326] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:08.022904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b98f7-f193-402a-93fb-120cbcb003c6 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.023198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b98f7-f193-402a-93fb-120cbcb003c6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.023797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b98f7-f193-402a-93fb-120cbcb003c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.042202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-616b98f7-f193-402a-93fb-120cbcb003c6 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:08.048924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-616b98f7-f193-402a-93fb-120cbcb003c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:08.051721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:08.052594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.053029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.053463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.054366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:08.054881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:08.056408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:08.074418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 165/327] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:08.074418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:08.092485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:08.150708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 163/328] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:08.176115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b98f7-f193-402a-93fb-120cbcb003c6 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:08.196245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0fae-c9cd-4ccf-8c02-3dfefa94aee8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:08.240022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc81e5-76bc-49b7-8c6a-c73c2d4d0ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:08.241810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc81e5-76bc-49b7-8c6a-c73c2d4d0ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.242565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc81e5-76bc-49b7-8c6a-c73c2d4d0ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.243053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc81e5-76bc-49b7-8c6a-c73c2d4d0ff1 None admin] PATH_INFO: `/v3/users/1e6189b7eafe41498ab9ee5ff6f34779` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.245094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc81e5-76bc-49b7-8c6a-c73c2d4d0ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=1e6189b7eafe41498ab9ee5ff6f34779)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:08.247252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc81e5-76bc-49b7-8c6a-c73c2d4d0ff1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:08.250002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 166/329] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:08 2022] GET /identity/v3/users/1e6189b7eafe41498ab9ee5ff6f34779 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:08.256866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc81e5-76bc-49b7-8c6a-c73c2d4d0ff1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:08.288468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:08.299118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b98f7-f193-402a-93fb-120cbcb003c6 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:08.348533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1690-0375-4330-b8a8-774a464d6d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:08.349712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1690-0375-4330-b8a8-774a464d6d4d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.350005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1690-0375-4330-b8a8-774a464d6d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.350287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1690-0375-4330-b8a8-774a464d6d4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.363517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:08.378541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1690-0375-4330-b8a8-774a464d6d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-da9c1690-0375-4330-b8a8-774a464d6d4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:08.390876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:08.391803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:08.392564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:08.395171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 164/330] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:08.400499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1690-0375-4330-b8a8-774a464d6d4d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:08.411136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc81e5-76bc-49b7-8c6a-c73c2d4d0ff1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:08.463159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b3ce-74e6-4632-9583-e0c0339b3dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:08.464169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b3ce-74e6-4632-9583-e0c0339b3dbd None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.464469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b3ce-74e6-4632-9583-e0c0339b3dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.464863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b3ce-74e6-4632-9583-e0c0339b3dbd None admin] PATH_INFO: `/v3/system/users/1e6189b7eafe41498ab9ee5ff6f34779/roles/8ca1560f736e42cc82249ede008d9bc3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.467550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0b3ce-74e6-4632-9583-e0c0339b3dbd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e6189b7eafe41498ab9ee5ff6f34779, role_id=8ca1560f736e42cc82249ede008d9bc3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:08.469188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0b3ce-74e6-4632-9583-e0c0339b3dbd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:08.482692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 167/331] 10.222.0.72 () {58 vars in 1334 bytes} [Tue Jul 12 14:20:08 2022] PUT /identity/v3/system/users/1e6189b7eafe41498ab9ee5ff6f34779/roles/8ca1560f736e42cc82249ede008d9bc3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:20:08.536582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1690-0375-4330-b8a8-774a464d6d4d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:08.576737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:08.578268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.578755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.579326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.580331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:08.580844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:08.582668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:08.593291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 165/332] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:08.599258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b3ce-74e6-4632-9583-e0c0339b3dbd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:08.712675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b3ce-74e6-4632-9583-e0c0339b3dbd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:08.750153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03e20c-63a2-4cae-a834-32e5926032dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:08.751503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e20c-63a2-4cae-a834-32e5926032dc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.751994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e20c-63a2-4cae-a834-32e5926032dc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.752544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e20c-63a2-4cae-a834-32e5926032dc None admin] PATH_INFO: `/v3/users/b093aed76dd2471391de585504881ccb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.753958 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03e20c-63a2-4cae-a834-32e5926032dc None admin] RBAC: Authorizing `identity:get_user(user_id=b093aed76dd2471391de585504881ccb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:08.755678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03e20c-63a2-4cae-a834-32e5926032dc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:08.757894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 168/333] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:08 2022] GET /identity/v3/users/b093aed76dd2471391de585504881ccb => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:08.763286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:08.780776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:08.873462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933165d6-7174-4616-80b0-6eff86a79bbf None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:08.910429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed4faf-fb93-4ccd-bced-301f4ec8ba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:08.911471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed4faf-fb93-4ccd-bced-301f4ec8ba61 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.911961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed4faf-fb93-4ccd-bced-301f4ec8ba61 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.912467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed4faf-fb93-4ccd-bced-301f4ec8ba61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.913567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed4faf-fb93-4ccd-bced-301f4ec8ba61 None admin] RBAC: Adding query filter params (role.id=36219e61b6d84e06b7585b5dca9f1c95, user.id=b093aed76dd2471391de585504881ccb, scope.system=all) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:08.914089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed4faf-fb93-4ccd-bced-301f4ec8ba61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:08.915760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed4faf-fb93-4ccd-bced-301f4ec8ba61 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:08.928918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 166/334] 10.222.0.72 () {56 vars in 1308 bytes} [Tue Jul 12 14:20:08 2022] GET /identity/v3/role_assignments?user.id=b093aed76dd2471391de585504881ccb&scope.system=all&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:10.090702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b283-8d0f-46a0-b2d2-1d70bf1bff06 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:10.091687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b283-8d0f-46a0-b2d2-1d70bf1bff06 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:10.092227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b283-8d0f-46a0-b2d2-1d70bf1bff06 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:10.094068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 169/335] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:10.100053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846c2a-883b-4e45-8d7d-e66e900d67b3 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:10.100909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846c2a-883b-4e45-8d7d-e66e900d67b3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:10.101397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48846c2a-883b-4e45-8d7d-e66e900d67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:10.122833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-48846c2a-883b-4e45-8d7d-e66e900d67b3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:10.124353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-48846c2a-883b-4e45-8d7d-e66e900d67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:10.208585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 167/336] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:10.256482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b283-8d0f-46a0-b2d2-1d70bf1bff06 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:10.272734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:10.388361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b283-8d0f-46a0-b2d2-1d70bf1bff06 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:10.432527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9714d2-21cb-428b-b5ab-730eea0e6865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:10.433719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9714d2-21cb-428b-b5ab-730eea0e6865 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:10.434209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9714d2-21cb-428b-b5ab-730eea0e6865 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:10.434693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9714d2-21cb-428b-b5ab-730eea0e6865 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:10.448909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9714d2-21cb-428b-b5ab-730eea0e6865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1b9714d2-21cb-428b-b5ab-730eea0e6865 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:10.457430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:10.458300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:10.459116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:10.461447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 170/337] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:10.467422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48846c2a-883b-4e45-8d7d-e66e900d67b3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:10.470562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:10.505694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c685c-c6ac-4eb9-8eeb-fce2d3be859e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:10.506315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c685c-c6ac-4eb9-8eeb-fce2d3be859e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:10.508644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c685c-c6ac-4eb9-8eeb-fce2d3be859e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:10.510261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 171/338] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:10.515225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2dee2-9939-4d42-aa18-926a26194954 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:10.515763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2dee2-9939-4d42-aa18-926a26194954 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:10.516240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2dee2-9939-4d42-aa18-926a26194954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:10.545257 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-24d2dee2-9939-4d42-aa18-926a26194954 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:10.547905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-24d2dee2-9939-4d42-aa18-926a26194954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:10.641151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48846c2a-883b-4e45-8d7d-e66e900d67b3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:10.663188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:10.670612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 172/339] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:10.700468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:10.701573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:10.702062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:10.702542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:10.703533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:10.704045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:10.706193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:10.706379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2dee2-9939-4d42-aa18-926a26194954 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:10.722171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 168/340] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:10.728201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:10.818799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:10.833085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2dee2-9939-4d42-aa18-926a26194954 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:10.863499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7947b-429f-4048-b6b8-a868a55d9e43 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:10.880513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f021-a2f9-415b-be0d-eaec1ffbb908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:10.881389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f021-a2f9-415b-be0d-eaec1ffbb908 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:10.881680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f021-a2f9-415b-be0d-eaec1ffbb908 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:10.881959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f021-a2f9-415b-be0d-eaec1ffbb908 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:10.895066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f021-a2f9-415b-be0d-eaec1ffbb908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ec64f021-a2f9-415b-be0d-eaec1ffbb908 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:10.909063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:10.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:10.910708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:10.913673 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 173/341] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:10.919329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f021-a2f9-415b-be0d-eaec1ffbb908 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:10.920252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996971b-4453-4698-9423-c4e45db7cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:10.921190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996971b-4453-4698-9423-c4e45db7cf83 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:10.921725 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996971b-4453-4698-9423-c4e45db7cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:10.922204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996971b-4453-4698-9423-c4e45db7cf83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.012130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996971b-4453-4698-9423-c4e45db7cf83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:11.014007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996971b-4453-4698-9423-c4e45db7cf83 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:11.099385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:11.105483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:11.131936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 169/342] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:11.137877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996971b-4453-4698-9423-c4e45db7cf83 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:11.190070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f021-a2f9-415b-be0d-eaec1ffbb908 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:11.242465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996971b-4453-4698-9423-c4e45db7cf83 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:11.247477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:11.248172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:11.248459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:11.248743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.249510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:11.249822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:11.251803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:11.265040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 174/343] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:11.271778 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:11.282225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78389c0-980b-44b9-8d56-af84167bbde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:11.283515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78389c0-980b-44b9-8d56-af84167bbde5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:11.284012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78389c0-980b-44b9-8d56-af84167bbde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:11.284526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78389c0-980b-44b9-8d56-af84167bbde5 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.285946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78389c0-980b-44b9-8d56-af84167bbde5 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:11.287640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78389c0-980b-44b9-8d56-af84167bbde5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:11.289942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 170/344] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:11 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:11.295478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78389c0-980b-44b9-8d56-af84167bbde5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:11.332521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:11.409964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78389c0-980b-44b9-8d56-af84167bbde5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:11.436689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534f70f-28c8-4b31-b1ec-ebadc72d07cc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:11.452281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617165-83ed-4fd9-9f76-d6c2cd1feaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:11.453806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617165-83ed-4fd9-9f76-d6c2cd1feaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:11.454435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617165-83ed-4fd9-9f76-d6c2cd1feaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:11.455040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617165-83ed-4fd9-9f76-d6c2cd1feaf0 None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.462852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d617165-83ed-4fd9-9f76-d6c2cd1feaf0 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:11.464593 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d617165-83ed-4fd9-9f76-d6c2cd1feaf0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:11.466806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:11.467380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 171/345] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:11 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:11.473891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617165-83ed-4fd9-9f76-d6c2cd1feaf0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:11.492458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74102b03-4335-419d-8c81-30be682707e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:11.493126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74102b03-4335-419d-8c81-30be682707e3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:11.493410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74102b03-4335-419d-8c81-30be682707e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:11.493683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74102b03-4335-419d-8c81-30be682707e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.583278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:11.586845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617165-83ed-4fd9-9f76-d6c2cd1feaf0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:11.595578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74102b03-4335-419d-8c81-30be682707e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:11.597198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74102b03-4335-419d-8c81-30be682707e3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:11.625812 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e29b4-6e01-4e39-97d2-fddd5e88595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:11.626660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e29b4-6e01-4e39-97d2-fddd5e88595e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:11.626993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e29b4-6e01-4e39-97d2-fddd5e88595e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:11.627278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e29b4-6e01-4e39-97d2-fddd5e88595e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.628119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e29b4-6e01-4e39-97d2-fddd5e88595e None admin] RBAC: Adding query filter params (group.id=2ef89f293c254e099f612f37a7dbcb04, role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=d0340b60166b4c069c60576799d26a32) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:11.628434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e29b4-6e01-4e39-97d2-fddd5e88595e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:11.630108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e29b4-6e01-4e39-97d2-fddd5e88595e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:11.636623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 172/346] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:11 2022] GET /identity/v3/role_assignments?group.id=2ef89f293c254e099f612f37a7dbcb04&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:11.730361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 175/347] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:11.731568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d288a0-056e-4a8b-aea3-b14305e6c9c7 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:11.731867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d288a0-056e-4a8b-aea3-b14305e6c9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:11.732155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d288a0-056e-4a8b-aea3-b14305e6c9c7 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.733637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 173/348] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:11.736228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74102b03-4335-419d-8c81-30be682707e3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:11.744011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dc5e1-8b86-4359-b833-0b39e920d2d4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:11.744303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dc5e1-8b86-4359-b833-0b39e920d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:11.744589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dc5e1-8b86-4359-b833-0b39e920d2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.760218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:11.784120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-0a2dc5e1-8b86-4359-b833-0b39e920d2d4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:11.785453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0a2dc5e1-8b86-4359-b833-0b39e920d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:11.849504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74102b03-4335-419d-8c81-30be682707e3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:11.890929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 174/349] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 14:20:11.896046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa864b7-ad05-4231-99ca-545357ff7292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:11.897133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa864b7-ad05-4231-99ca-545357ff7292 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:11.897591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa864b7-ad05-4231-99ca-545357ff7292 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:11.898041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa864b7-ad05-4231-99ca-545357ff7292 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:11.899473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa864b7-ad05-4231-99ca-545357ff7292 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:11.901107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa864b7-ad05-4231-99ca-545357ff7292 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:11.903308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 176/350] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:11 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:11.909350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dc5e1-8b86-4359-b833-0b39e920d2d4 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:11.954274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa864b7-ad05-4231-99ca-545357ff7292 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:12.027291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:12.039540 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dc5e1-8b86-4359-b833-0b39e920d2d4 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:12.090883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a426b7-0afa-46cd-bff8-eabdd8cae932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:12.092002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a426b7-0afa-46cd-bff8-eabdd8cae932 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.092437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a426b7-0afa-46cd-bff8-eabdd8cae932 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.092947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a426b7-0afa-46cd-bff8-eabdd8cae932 None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.094405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a426b7-0afa-46cd-bff8-eabdd8cae932 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:12.096720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a426b7-0afa-46cd-bff8-eabdd8cae932 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:12.099027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 175/351] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:11 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:12.104247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a426b7-0afa-46cd-bff8-eabdd8cae932 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:12.112491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:12.137403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa864b7-ad05-4231-99ca-545357ff7292 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:12.210263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8446e-ee03-4d92-b38f-9d66a05fb072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:12.211408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8446e-ee03-4d92-b38f-9d66a05fb072 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.211874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8446e-ee03-4d92-b38f-9d66a05fb072 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.212360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8446e-ee03-4d92-b38f-9d66a05fb072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.235394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8446e-ee03-4d92-b38f-9d66a05fb072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4ae8446e-ee03-4d92-b38f-9d66a05fb072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:12.254698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:12.255675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:12.256454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:12.261317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 177/352] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:12.266026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8446e-ee03-4d92-b38f-9d66a05fb072 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:12.309060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a426b7-0afa-46cd-bff8-eabdd8cae932 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:12.387571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f139f7-91fa-42ac-9034-57fc2bdebfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:12.388295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f139f7-91fa-42ac-9034-57fc2bdebfdf None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.388586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f139f7-91fa-42ac-9034-57fc2bdebfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.388868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f139f7-91fa-42ac-9034-57fc2bdebfdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.389723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f139f7-91fa-42ac-9034-57fc2bdebfdf None admin] RBAC: Adding query filter params (group.id=2ef89f293c254e099f612f37a7dbcb04, role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=d0340b60166b4c069c60576799d26a32) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:12.390037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f139f7-91fa-42ac-9034-57fc2bdebfdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:12.392718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f139f7-91fa-42ac-9034-57fc2bdebfdf None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:12.407064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 176/353] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:12 2022] GET /identity/v3/role_assignments?group.id=2ef89f293c254e099f612f37a7dbcb04&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:12.408575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4c38-2253-45bc-8007-ede7f730ad77 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.408874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4c38-2253-45bc-8007-ede7f730ad77 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.409166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4c38-2253-45bc-8007-ede7f730ad77 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.414259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 177/354] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:12.416237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b293-b631-4048-86ab-d931e401473e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.416237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b293-b631-4048-86ab-d931e401473e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.416520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b293-b631-4048-86ab-d931e401473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.422476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8446e-ee03-4d92-b38f-9d66a05fb072 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:12.447918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f750b293-b631-4048-86ab-d931e401473e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:12.449180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f750b293-b631-4048-86ab-d931e401473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:12.468458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:12.484973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:12.486157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.486666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.487185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.488244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:12.488854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:12.490440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:12.500700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 178/355] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:12.507007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:12.525267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:12.540501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 178/356] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:12.541952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc82c3-6c9b-4cbf-b834-8b4cb349fe98 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.542249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc82c3-6c9b-4cbf-b834-8b4cb349fe98 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.542528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc82c3-6c9b-4cbf-b834-8b4cb349fe98 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.544111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 179/357] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:12.549899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5db4f6-dbf8-48b6-a924-5b7b5add31d3 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.550196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5db4f6-dbf8-48b6-a924-5b7b5add31d3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.550464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5db4f6-dbf8-48b6-a924-5b7b5add31d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.583999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-3b5db4f6-dbf8-48b6-a924-5b7b5add31d3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:12.585156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3b5db4f6-dbf8-48b6-a924-5b7b5add31d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:12.679451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 180/358] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:12.680734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5db4f6-dbf8-48b6-a924-5b7b5add31d3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:12.726643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762df1f-429f-481d-a641-86c2519878cd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:12.768132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bdab3-45d4-4dca-9cf2-d2f8f578464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:12.768865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bdab3-45d4-4dca-9cf2-d2f8f578464c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.769095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bdab3-45d4-4dca-9cf2-d2f8f578464c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.769448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bdab3-45d4-4dca-9cf2-d2f8f578464c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.773268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:12.796092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5db4f6-dbf8-48b6-a924-5b7b5add31d3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:12.837773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a579e-4dae-43dd-9d10-0da9fb729c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:12.838606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a579e-4dae-43dd-9d10-0da9fb729c4e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:12.838938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a579e-4dae-43dd-9d10-0da9fb729c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:12.839223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a579e-4dae-43dd-9d10-0da9fb729c4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:12.852330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a579e-4dae-43dd-9d10-0da9fb729c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-006a579e-4dae-43dd-9d10-0da9fb729c4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:12.860297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:12.861717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:12.862497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 181/359] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:12.864662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bdab3-45d4-4dca-9cf2-d2f8f578464c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:12.866363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bdab3-45d4-4dca-9cf2-d2f8f578464c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:12.867292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a579e-4dae-43dd-9d10-0da9fb729c4e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:12.882988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:12.983597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a579e-4dae-43dd-9d10-0da9fb729c4e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.007246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 179/360] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:20:13.009613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6166541-251f-4207-8d7b-a0ab3c3350eb None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.010227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6166541-251f-4207-8d7b-a0ab3c3350eb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.010710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6166541-251f-4207-8d7b-a0ab3c3350eb None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.012753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 180/361] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:13.013959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6166541-251f-4207-8d7b-a0ab3c3350eb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.027616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d2172-3a83-406b-8224-351aa316776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.028452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2172-3a83-406b-8224-351aa316776a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.028744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2172-3a83-406b-8224-351aa316776a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.029029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2172-3a83-406b-8224-351aa316776a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.040891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d2172-3a83-406b-8224-351aa316776a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-163d2172-3a83-406b-8224-351aa316776a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:13.049869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:13.050791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:13.051622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:13.052950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 182/362] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:13.053452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3868-a2be-48da-96d0-1b6cb3916741 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.053751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3868-a2be-48da-96d0-1b6cb3916741 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.054037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3868-a2be-48da-96d0-1b6cb3916741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.065495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:13.078867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e38a3868-a2be-48da-96d0-1b6cb3916741 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:13.080481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e38a3868-a2be-48da-96d0-1b6cb3916741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:13.165492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 183/363] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:13.166548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a3868-a2be-48da-96d0-1b6cb3916741 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.181452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6166541-251f-4207-8d7b-a0ab3c3350eb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.193656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:13.231104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.232254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.232780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.233293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.234278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:13.234784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:13.237017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:13.248392 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 181/364] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:13.249485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.286307 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a3868-a2be-48da-96d0-1b6cb3916741 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.320455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:13.325754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00c0f-234f-4247-8309-cbdb9a2ec532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.326609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00c0f-234f-4247-8309-cbdb9a2ec532 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.327950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00c0f-234f-4247-8309-cbdb9a2ec532 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.328234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00c0f-234f-4247-8309-cbdb9a2ec532 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.331132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e00c0f-234f-4247-8309-cbdb9a2ec532 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:13.332696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e00c0f-234f-4247-8309-cbdb9a2ec532 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:13.334569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 184/365] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:13.336127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00c0f-234f-4247-8309-cbdb9a2ec532 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.385538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfefac4-770e-4f3d-876a-beb13c87f912 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.427154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.427761 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.428048 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.428384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.429151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:13.429509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:13.430953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:13.439892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 182/366] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:13.441125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.471541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00c0f-234f-4247-8309-cbdb9a2ec532 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.477224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:13.510882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934e1f7-e39e-44fb-a343-8f22826c5ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.512121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934e1f7-e39e-44fb-a343-8f22826c5ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.512723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934e1f7-e39e-44fb-a343-8f22826c5ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.513261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934e1f7-e39e-44fb-a343-8f22826c5ff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.525182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934e1f7-e39e-44fb-a343-8f22826c5ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-2934e1f7-e39e-44fb-a343-8f22826c5ff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:13.534456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:13.535345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:13.536108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:13.538517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 185/367] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:13.539632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934e1f7-e39e-44fb-a343-8f22826c5ff7 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.549694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0db1e-5c1f-4cd1-bb6d-c4f97f40f681 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.588484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda415d-d670-4271-a48e-558debd79312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.589382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda415d-d670-4271-a48e-558debd79312 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.589733 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda415d-d670-4271-a48e-558debd79312 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.590016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda415d-d670-4271-a48e-558debd79312 None admin] PATH_INFO: `/v3/users/1e6189b7eafe41498ab9ee5ff6f34779` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.591340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda415d-d670-4271-a48e-558debd79312 None admin] RBAC: Authorizing `identity:get_user(user_id=1e6189b7eafe41498ab9ee5ff6f34779)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:13.592787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda415d-d670-4271-a48e-558debd79312 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:13.596271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 183/368] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/users/1e6189b7eafe41498ab9ee5ff6f34779 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:13.597280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda415d-d670-4271-a48e-558debd79312 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.610889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:13.659054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934e1f7-e39e-44fb-a343-8f22826c5ff7 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.695914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b4fe-3f7a-492b-9d60-f65c911472f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.697151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b4fe-3f7a-492b-9d60-f65c911472f1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.697766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b4fe-3f7a-492b-9d60-f65c911472f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.698260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b4fe-3f7a-492b-9d60-f65c911472f1 None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.699743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3b4fe-3f7a-492b-9d60-f65c911472f1 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:13.701250 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda415d-d670-4271-a48e-558debd79312 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.701647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3b4fe-3f7a-492b-9d60-f65c911472f1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:13.702847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:13.704322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 186/369] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:13.705884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b4fe-3f7a-492b-9d60-f65c911472f1 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.744037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90152c9-acfd-4b94-9570-02a1917da029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.745484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90152c9-acfd-4b94-9570-02a1917da029 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.745778 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90152c9-acfd-4b94-9570-02a1917da029 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.746114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90152c9-acfd-4b94-9570-02a1917da029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.830329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b4fe-3f7a-492b-9d60-f65c911472f1 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:13.832034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90152c9-acfd-4b94-9570-02a1917da029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:13.833524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90152c9-acfd-4b94-9570-02a1917da029 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:13.866624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:13.884978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:13.886207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:13.887257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:13.888177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:13.890360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:13.891016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:13.893154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:13.906452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 187/370] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:13.907525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.956264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 184/371] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:13.957406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90152c9-acfd-4b94-9570-02a1917da029 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:13.960207 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:14.033346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa41eb-3e54-49eb-b791-8e431e08309f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:14.073721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90152c9-acfd-4b94-9570-02a1917da029 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:14.101689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:14.102359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:14.102644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:14.102953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:14.104450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] RBAC: Adding query filter params (role.id=8ca1560f736e42cc82249ede008d9bc3, user.id=1e6189b7eafe41498ab9ee5ff6f34779, scope.system=all) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:14.104768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:14.106406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:14.119361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:14.120412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:14.120918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:14.121416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:14.123073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] RBAC: Adding query filter params (group.id=2ef89f293c254e099f612f37a7dbcb04, role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=312f010075904c318a115286ea12a499) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:14.123622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:14.123821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 188/372] 10.222.0.72 () {56 vars in 1308 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/role_assignments?user.id=1e6189b7eafe41498ab9ee5ff6f34779&scope.system=all&role.id=8ca1560f736e42cc82249ede008d9bc3 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:14.124665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:14.125695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:14.138155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 185/373] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:13 2022] GET /identity/v3/role_assignments?group.id=2ef89f293c254e099f612f37a7dbcb04&scope.project.id=312f010075904c318a115286ea12a499&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:14.139524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:14.242878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:14.287435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:14.354994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da441ebf-7b8b-4034-a5d1-31ae704c595a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:14.396829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df3c96-ff17-424e-94fa-4569b41611f6 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:14.414455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa1b3d-3d73-4976-8414-c922c0025301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:14.415150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1b3d-3d73-4976-8414-c922c0025301 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:14.415438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1b3d-3d73-4976-8414-c922c0025301 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:14.415718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1b3d-3d73-4976-8414-c922c0025301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:14.476987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56881c7-6868-4b72-8324-02f976dac149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:14.477932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56881c7-6868-4b72-8324-02f976dac149 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:14.478162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56881c7-6868-4b72-8324-02f976dac149 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:14.478734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56881c7-6868-4b72-8324-02f976dac149 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:14.480178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56881c7-6868-4b72-8324-02f976dac149 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:14.481948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56881c7-6868-4b72-8324-02f976dac149 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:14.485246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 186/374] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:14 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:14.492476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56881c7-6868-4b72-8324-02f976dac149 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:14.509883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa1b3d-3d73-4976-8414-c922c0025301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:14.511338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa1b3d-3d73-4976-8414-c922c0025301 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:14.605086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:14.654051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56881c7-6868-4b72-8324-02f976dac149 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:14.669126 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 189/375] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:14.670548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0578-c77f-4745-8984-bb0f0432bb71 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:14.670868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0578-c77f-4745-8984-bb0f0432bb71 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:14.671154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0578-c77f-4745-8984-bb0f0432bb71 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:14.672705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 190/376] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:14.678330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0578-c77f-4745-8984-bb0f0432bb71 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:14.704857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c0ce3-45ac-4441-baa5-2d66ad2f7c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:14.705844 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0ce3-45ac-4441-baa5-2d66ad2f7c4a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:14.706127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0ce3-45ac-4441-baa5-2d66ad2f7c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:14.706399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0ce3-45ac-4441-baa5-2d66ad2f7c4a None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:14.708327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c0ce3-45ac-4441-baa5-2d66ad2f7c4a None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:14.709879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c0ce3-45ac-4441-baa5-2d66ad2f7c4a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:14.711982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 187/377] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:14 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:14.713369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff5e8-3ccf-4bf3-8265-f01beed4a866 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:14.713664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff5e8-3ccf-4bf3-8265-f01beed4a866 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:14.713945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff5e8-3ccf-4bf3-8265-f01beed4a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:14.719601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:14.735094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-34dff5e8-3ccf-4bf3-8265-f01beed4a866 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:14.736587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-34dff5e8-3ccf-4bf3-8265-f01beed4a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:14.807069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0578-c77f-4745-8984-bb0f0432bb71 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:14.822003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 188/378] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:14.823372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dff5e8-3ccf-4bf3-8265-f01beed4a866 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:14.855593 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9667d-2adb-4031-b5ee-2dd031cdadfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:14.857024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9667d-2adb-4031-b5ee-2dd031cdadfd None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:14.857478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9667d-2adb-4031-b5ee-2dd031cdadfd None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:14.857900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9667d-2adb-4031-b5ee-2dd031cdadfd None admin] PATH_INFO: `/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:14.859783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9667d-2adb-4031-b5ee-2dd031cdadfd None admin] RBAC: Authorizing `identity:get_project(project_id=d3334aa68e9e41b9ae01ceb2502f9b38)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:14.861948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9667d-2adb-4031-b5ee-2dd031cdadfd None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:14.865390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 191/379] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:14 2022] GET /identity/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:14.866368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9667d-2adb-4031-b5ee-2dd031cdadfd None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:14.888594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:14.957508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dff5e8-3ccf-4bf3-8265-f01beed4a866 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:14.996084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:14.998845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9667d-2adb-4031-b5ee-2dd031cdadfd None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:15.003548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.004220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.004505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.004785 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.005622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] RBAC: Adding query filter params (group.id=2ef89f293c254e099f612f37a7dbcb04, role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=312f010075904c318a115286ea12a499) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:15.005994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:15.007518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:15.013833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 189/380] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:14 2022] GET /identity/v3/role_assignments?group.id=2ef89f293c254e099f612f37a7dbcb04&scope.project.id=312f010075904c318a115286ea12a499&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:15.014753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:15.050958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0bbe3-2244-4f12-84ab-dcaac6750248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.052062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bbe3-2244-4f12-84ab-dcaac6750248 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.053121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bbe3-2244-4f12-84ab-dcaac6750248 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.053562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0bbe3-2244-4f12-84ab-dcaac6750248 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.069730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0bbe3-2244-4f12-84ab-dcaac6750248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-ffd0bbe3-2244-4f12-84ab-dcaac6750248 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:15.080696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:15.081899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:15.082967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:15.087542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 192/381] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:15.088264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acb5d-8b3b-4140-904b-8e47f84e58b2 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.088553 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acb5d-8b3b-4140-904b-8e47f84e58b2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.088878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acb5d-8b3b-4140-904b-8e47f84e58b2 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.090296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 193/382] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:15.091312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40acb5d-8b3b-4140-904b-8e47f84e58b2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:15.162817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eba36-9be4-41ab-9301-28ebf8a8ea11 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:15.192182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:15.209780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c318b-d948-468d-aa8a-9098ae2c752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.210660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c318b-d948-468d-aa8a-9098ae2c752f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.211008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c318b-d948-468d-aa8a-9098ae2c752f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.211289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c318b-d948-468d-aa8a-9098ae2c752f None admin] PATH_INFO: `/v3/groups/b9ebc1386d8b4215865047be50513efd` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.219897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c318b-d948-468d-aa8a-9098ae2c752f None admin] RBAC: Authorizing `identity:get_group(group_id=b9ebc1386d8b4215865047be50513efd)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:15.222183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c318b-d948-468d-aa8a-9098ae2c752f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:15.224922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 190/383] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:15 2022] GET /identity/v3/groups/b9ebc1386d8b4215865047be50513efd => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:15.228146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca03b2-a1bb-49ee-927a-6ee9d0314177 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.228146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca03b2-a1bb-49ee-927a-6ee9d0314177 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.228146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca03b2-a1bb-49ee-927a-6ee9d0314177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.229496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40acb5d-8b3b-4140-904b-8e47f84e58b2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:15.248644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d6ca03b2-a1bb-49ee-927a-6ee9d0314177 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:15.250075 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d6ca03b2-a1bb-49ee-927a-6ee9d0314177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:15.282857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.283952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.284409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.285160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.286345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:15.287017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:15.289156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:15.300358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 194/384] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:15.301462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:15.320557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:15.335244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 191/385] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:15.336091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca03b2-a1bb-49ee-927a-6ee9d0314177 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:15.426801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842104a-de65-4b5e-9797-8e6cf97b67de None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:15.449753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca03b2-a1bb-49ee-927a-6ee9d0314177 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:15.470973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.471943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.472376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.473248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.474523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] RBAC: Adding query filter params (group.id=b9ebc1386d8b4215865047be50513efd, role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d3334aa68e9e41b9ae01ceb2502f9b38) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:15.475026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:15.477300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:15.484780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 195/386] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:15 2022] GET /identity/v3/role_assignments?group.id=b9ebc1386d8b4215865047be50513efd&scope.project.id=d3334aa68e9e41b9ae01ceb2502f9b38&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:15.486028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:15.489047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:15.497346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb8cdf-a64d-434d-a318-81077b33eda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.498386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb8cdf-a64d-434d-a318-81077b33eda1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.498677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb8cdf-a64d-434d-a318-81077b33eda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.499091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb8cdf-a64d-434d-a318-81077b33eda1 None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.504093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb8cdf-a64d-434d-a318-81077b33eda1 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:15.505739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb8cdf-a64d-434d-a318-81077b33eda1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:15.507753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 192/387] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:15 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:15.513242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb8cdf-a64d-434d-a318-81077b33eda1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:15.608153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2910a-0943-47be-a8a7-adc2cef9bdf6 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:15.629845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:15.652281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9598511-e03d-42e7-9709-f217587294fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.653420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9598511-e03d-42e7-9709-f217587294fd None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.653922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9598511-e03d-42e7-9709-f217587294fd None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.654378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9598511-e03d-42e7-9709-f217587294fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.668474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9598511-e03d-42e7-9709-f217587294fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f9598511-e03d-42e7-9709-f217587294fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:15.679369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:15.680299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:15.681058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:15.683719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 196/388] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:15.691834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9598511-e03d-42e7-9709-f217587294fd None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:15.713664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb8cdf-a64d-434d-a318-81077b33eda1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:15.770800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:15.788840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f5bd-468a-4b7c-95de-740b2f6ae065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.789737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f5bd-468a-4b7c-95de-740b2f6ae065 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.790019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f5bd-468a-4b7c-95de-740b2f6ae065 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.790296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38f5bd-468a-4b7c-95de-740b2f6ae065 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.791662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38f5bd-468a-4b7c-95de-740b2f6ae065 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:15.793112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38f5bd-468a-4b7c-95de-740b2f6ae065 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:15.794877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 193/389] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:15 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:15.803557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f5bd-468a-4b7c-95de-740b2f6ae065 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:15.849951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9598511-e03d-42e7-9709-f217587294fd None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:15.922735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:15.923963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:15.924250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:15.924527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:15.925544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:15.925854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:15.927990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:15.946956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 197/390] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:15.950985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:16.011452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38f5bd-468a-4b7c-95de-740b2f6ae065 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:16.066145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:16.085629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823cea-388c-441d-94bd-4d2cf90838bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:16.086573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823cea-388c-441d-94bd-4d2cf90838bd None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:16.086890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823cea-388c-441d-94bd-4d2cf90838bd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:16.087168 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823cea-388c-441d-94bd-4d2cf90838bd None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32/groups/2ef89f293c254e099f612f37a7dbcb04/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:16.090145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55823cea-388c-441d-94bd-4d2cf90838bd None admin] RBAC: Authorizing `identity:create_grant(project_id=d0340b60166b4c069c60576799d26a32, group_id=2ef89f293c254e099f612f37a7dbcb04, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:16.091604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55823cea-388c-441d-94bd-4d2cf90838bd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:16.119259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 194/391] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jul 12 14:20:15 2022] PUT /identity/v3/projects/d0340b60166b4c069c60576799d26a32/groups/2ef89f293c254e099f612f37a7dbcb04/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:16.128601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5373043-3410-4fde-a836-2df7bee683de None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:16.155419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:16.170337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a91b4-842f-4c63-abd1-d58a5e665298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:16.171458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a91b4-842f-4c63-abd1-d58a5e665298 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:16.171746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a91b4-842f-4c63-abd1-d58a5e665298 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:16.172837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a91b4-842f-4c63-abd1-d58a5e665298 None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:16.174654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a91b4-842f-4c63-abd1-d58a5e665298 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:16.176231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a91b4-842f-4c63-abd1-d58a5e665298 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:16.178327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 198/392] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:15 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:16.183664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823cea-388c-441d-94bd-4d2cf90838bd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:16.305014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823cea-388c-441d-94bd-4d2cf90838bd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:16.342964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c06d2d-d01b-4ffc-96a4-6fd0bd4a60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:16.343930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c06d2d-d01b-4ffc-96a4-6fd0bd4a60f3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:16.344219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c06d2d-d01b-4ffc-96a4-6fd0bd4a60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:16.344496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c06d2d-d01b-4ffc-96a4-6fd0bd4a60f3 None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:16.346448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c06d2d-d01b-4ffc-96a4-6fd0bd4a60f3 None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:16.347937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c06d2d-d01b-4ffc-96a4-6fd0bd4a60f3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:16.349663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 195/393] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:16 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:16.358380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a91b4-842f-4c63-abd1-d58a5e665298 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:16.493249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a91b4-842f-4c63-abd1-d58a5e665298 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:16.550123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddbd9c-b90f-4e35-ba5b-98739f20e4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:16.551059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddbd9c-b90f-4e35-ba5b-98739f20e4ba None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:16.551352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddbd9c-b90f-4e35-ba5b-98739f20e4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:16.551623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddbd9c-b90f-4e35-ba5b-98739f20e4ba None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32/groups/2ef89f293c254e099f612f37a7dbcb04/roles/69f0d114dbd94de3896c418607fa6e1a` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:16.554044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddbd9c-b90f-4e35-ba5b-98739f20e4ba None admin] RBAC: Authorizing `identity:create_grant(project_id=d0340b60166b4c069c60576799d26a32, group_id=2ef89f293c254e099f612f37a7dbcb04, role_id=69f0d114dbd94de3896c418607fa6e1a)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:16.555541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddbd9c-b90f-4e35-ba5b-98739f20e4ba None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:16.574747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 199/394] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jul 12 14:20:16 2022] PUT /identity/v3/projects/d0340b60166b4c069c60576799d26a32/groups/2ef89f293c254e099f612f37a7dbcb04/roles/69f0d114dbd94de3896c418607fa6e1a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:16.802992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386e6a-4b68-4a41-ac2a-959a3660f4fd None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:16.803344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386e6a-4b68-4a41-ac2a-959a3660f4fd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:16.803517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386e6a-4b68-4a41-ac2a-959a3660f4fd None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:16.805202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 196/395] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:16.812397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326316ed-d83d-43db-86d6-782b29e85a2d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:16.812697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326316ed-d83d-43db-86d6-782b29e85a2d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:16.812982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326316ed-d83d-43db-86d6-782b29e85a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:16.832940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-326316ed-d83d-43db-86d6-782b29e85a2d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:16.834189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-326316ed-d83d-43db-86d6-782b29e85a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:16.884452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:16.908273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 200/396] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:16.930016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b386e6a-4b68-4a41-ac2a-959a3660f4fd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:16.992253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:17.044270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b386e6a-4b68-4a41-ac2a-959a3660f4fd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:17.081985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9ce41-e674-4e07-9d55-e4e54b26b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:17.082820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9ce41-e674-4e07-9d55-e4e54b26b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.083099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9ce41-e674-4e07-9d55-e4e54b26b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.083374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9ce41-e674-4e07-9d55-e4e54b26b4a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.094201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9ce41-e674-4e07-9d55-e4e54b26b4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-58a9ce41-e674-4e07-9d55-e4e54b26b4a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:17.102030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:17.102947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:17.104577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 197/397] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:17.109749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326316ed-d83d-43db-86d6-782b29e85a2d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:17.231081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326316ed-d83d-43db-86d6-782b29e85a2d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:17.271066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:17.271746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.272029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.272309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.273172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:17.273365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:17.274804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:17.286092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 201/398] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:17.291630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9ce41-e674-4e07-9d55-e4e54b26b4a4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:17.423987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9ce41-e674-4e07-9d55-e4e54b26b4a4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:17.439968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:17.461883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30ce76-90cf-4ce6-8ce6-e2f05e98fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:17.462759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30ce76-90cf-4ce6-8ce6-e2f05e98fd8d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.463069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30ce76-90cf-4ce6-8ce6-e2f05e98fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.463351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30ce76-90cf-4ce6-8ce6-e2f05e98fd8d None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.464531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30ce76-90cf-4ce6-8ce6-e2f05e98fd8d None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:17.465970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30ce76-90cf-4ce6-8ce6-e2f05e98fd8d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:17.471171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 198/399] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:17 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:17.474494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:17.532137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:17.595501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb49ec4-dd62-42ad-aed7-dad02b285f40 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:17.641356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e28511-dd6e-4883-8c62-997634bfb330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:17.642238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e28511-dd6e-4883-8c62-997634bfb330 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.643112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e28511-dd6e-4883-8c62-997634bfb330 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.643396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e28511-dd6e-4883-8c62-997634bfb330 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.647502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e28511-dd6e-4883-8c62-997634bfb330 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:17.648969 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e28511-dd6e-4883-8c62-997634bfb330 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:17.650993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 202/400] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:17 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:17.656836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30ce76-90cf-4ce6-8ce6-e2f05e98fd8d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:17.665173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e502f-3a98-4326-a092-2838c887da92 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.665396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e502f-3a98-4326-a092-2838c887da92 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.665673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e502f-3a98-4326-a092-2838c887da92 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.667399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 203/401] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:17.672275 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e6fa-0761-41bd-809a-f94f051e5086 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.672949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e6fa-0761-41bd-809a-f94f051e5086 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.672949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e6fa-0761-41bd-809a-f94f051e5086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.703837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4742e6fa-0761-41bd-809a-f94f051e5086 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:17.705517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4742e6fa-0761-41bd-809a-f94f051e5086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:17.788228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30ce76-90cf-4ce6-8ce6-e2f05e98fd8d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:17.817209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 204/402] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:17.830541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db1965-72ef-43f3-a208-22d9017e38b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:17.831919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db1965-72ef-43f3-a208-22d9017e38b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.832403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db1965-72ef-43f3-a208-22d9017e38b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.832891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db1965-72ef-43f3-a208-22d9017e38b0 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499/groups/2ef89f293c254e099f612f37a7dbcb04/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.835400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db1965-72ef-43f3-a208-22d9017e38b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=312f010075904c318a115286ea12a499, group_id=2ef89f293c254e099f612f37a7dbcb04, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:17.837113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db1965-72ef-43f3-a208-22d9017e38b0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:17.843533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742e6fa-0761-41bd-809a-f94f051e5086 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:17.865631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 199/403] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jul 12 14:20:17 2022] PUT /identity/v3/projects/312f010075904c318a115286ea12a499/groups/2ef89f293c254e099f612f37a7dbcb04/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:17.923263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:17.988307 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742e6fa-0761-41bd-809a-f94f051e5086 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:18.026067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbb17f-5624-4d98-bbfa-7dd4ba0139cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:18.027127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbb17f-5624-4d98-bbfa-7dd4ba0139cd None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:18.027537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbb17f-5624-4d98-bbfa-7dd4ba0139cd None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:18.027916 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbb17f-5624-4d98-bbfa-7dd4ba0139cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:18.039745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbb17f-5624-4d98-bbfa-7dd4ba0139cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-9cfbb17f-5624-4d98-bbfa-7dd4ba0139cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:18.050292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:18.051253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:18.052044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 205/404] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:18.056594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db1965-72ef-43f3-a208-22d9017e38b0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:18.141461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:18.175110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db1965-72ef-43f3-a208-22d9017e38b0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:18.210426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:18.211194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:18.211480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:18.211757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:18.212504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:18.212813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:18.214175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:18.223231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 200/405] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:18.232063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbb17f-5624-4d98-bbfa-7dd4ba0139cd None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:18.355890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbb17f-5624-4d98-bbfa-7dd4ba0139cd None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:18.357813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:18.391382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c6c9-19f0-4196-90ae-ac22dd061251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:18.392261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c6c9-19f0-4196-90ae-ac22dd061251 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:18.392579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c6c9-19f0-4196-90ae-ac22dd061251 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:18.392860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c6c9-19f0-4196-90ae-ac22dd061251 None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:18.396038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5c6c9-19f0-4196-90ae-ac22dd061251 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:18.397507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5c6c9-19f0-4196-90ae-ac22dd061251 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:18.402879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 206/406] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:18 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:18.405088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:18.520553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06d509-7cf2-4398-ba7e-427128ae1c35 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:18.523002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:18.556864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30071e-0efe-4220-b2c5-80179b019435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:18.557742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30071e-0efe-4220-b2c5-80179b019435 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:18.558029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30071e-0efe-4220-b2c5-80179b019435 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:18.558309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30071e-0efe-4220-b2c5-80179b019435 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:18.559513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30071e-0efe-4220-b2c5-80179b019435 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:18.560948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30071e-0efe-4220-b2c5-80179b019435 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:18.562968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 201/407] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:18 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:18.568611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c6c9-19f0-4196-90ae-ac22dd061251 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:18.673469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c6c9-19f0-4196-90ae-ac22dd061251 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:18.709381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c285a5-0040-423f-a802-6b21c20ffae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:18.710277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c285a5-0040-423f-a802-6b21c20ffae6 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:18.710562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c285a5-0040-423f-a802-6b21c20ffae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:18.710863 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c285a5-0040-423f-a802-6b21c20ffae6 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499/groups/2ef89f293c254e099f612f37a7dbcb04/roles/69f0d114dbd94de3896c418607fa6e1a` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:18.713060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c285a5-0040-423f-a802-6b21c20ffae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=312f010075904c318a115286ea12a499, group_id=2ef89f293c254e099f612f37a7dbcb04, role_id=69f0d114dbd94de3896c418607fa6e1a)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:18.714510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c285a5-0040-423f-a802-6b21c20ffae6 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:18.732352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 207/408] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jul 12 14:20:18 2022] PUT /identity/v3/projects/312f010075904c318a115286ea12a499/groups/2ef89f293c254e099f612f37a7dbcb04/roles/69f0d114dbd94de3896c418607fa6e1a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:20:18.792016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb299e-44a3-4b43-95c4-a717a846e58f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:18.792363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb299e-44a3-4b43-95c4-a717a846e58f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:18.792654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb299e-44a3-4b43-95c4-a717a846e58f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:18.794443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 202/409] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:18.800932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579bbb-5e54-45a3-a1f6-576893f427f8 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:18.801261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579bbb-5e54-45a3-a1f6-576893f427f8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:18.801511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579bbb-5e54-45a3-a1f6-576893f427f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:18.825458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e8579bbb-5e54-45a3-a1f6-576893f427f8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:18.827120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e8579bbb-5e54-45a3-a1f6-576893f427f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:18.866533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:18.926461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 208/410] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:18.953113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb299e-44a3-4b43-95c4-a717a846e58f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.068995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb299e-44a3-4b43-95c4-a717a846e58f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:19.104842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fbef8-f3d8-4e80-a51f-e13fd9c5c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:19.105652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fbef8-f3d8-4e80-a51f-e13fd9c5c4fe None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.105938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fbef8-f3d8-4e80-a51f-e13fd9c5c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.106215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fbef8-f3d8-4e80-a51f-e13fd9c5c4fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.117650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fbef8-f3d8-4e80-a51f-e13fd9c5c4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e89fbef8-f3d8-4e80-a51f-e13fd9c5c4fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:19.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:19.126402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:19.127770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 203/411] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:19.133586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8579bbb-5e54-45a3-a1f6-576893f427f8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.235441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c943-a3a7-4231-aa93-89f9adccc748 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.237051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c943-a3a7-4231-aa93-89f9adccc748 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.237534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c943-a3a7-4231-aa93-89f9adccc748 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.240309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 204/412] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:19.246658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107eb79-791f-43bd-8f1c-4270a133156d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.247810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107eb79-791f-43bd-8f1c-4270a133156d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.248436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107eb79-791f-43bd-8f1c-4270a133156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.270806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d107eb79-791f-43bd-8f1c-4270a133156d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:19.272342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d107eb79-791f-43bd-8f1c-4270a133156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:19.301922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8579bbb-5e54-45a3-a1f6-576893f427f8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:19.306026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:19.346817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5524cf1-ccca-4e7d-b40a-be04b9b376c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:19.347526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524cf1-ccca-4e7d-b40a-be04b9b376c0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.347801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524cf1-ccca-4e7d-b40a-be04b9b376c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.348087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524cf1-ccca-4e7d-b40a-be04b9b376c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.349148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524cf1-ccca-4e7d-b40a-be04b9b376c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:19.349462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524cf1-ccca-4e7d-b40a-be04b9b376c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:19.351569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524cf1-ccca-4e7d-b40a-be04b9b376c0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:19.362030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 209/413] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:19.362329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 205/414] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:19.367090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450505-782c-414f-b902-e549665b86b6 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.367090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450505-782c-414f-b902-e549665b86b6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.367090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450505-782c-414f-b902-e549665b86b6 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.367090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 210/415] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:19.368438 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107eb79-791f-43bd-8f1c-4270a133156d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.372406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64048c0b-1712-4c96-bc5d-e4e4db30b57b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.372716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64048c0b-1712-4c96-bc5d-e4e4db30b57b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.372993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64048c0b-1712-4c96-bc5d-e4e4db30b57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.399802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-64048c0b-1712-4c96-bc5d-e4e4db30b57b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:19.401311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-64048c0b-1712-4c96-bc5d-e4e4db30b57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:19.424989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:19.480274 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 211/416] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:19.481498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64048c0b-1712-4c96-bc5d-e4e4db30b57b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.504443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107eb79-791f-43bd-8f1c-4270a133156d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:19.549535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba5ffc-9e5b-4cdd-b1a4-533b209d273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:19.550564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5ffc-9e5b-4cdd-b1a4-533b209d273d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.551205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5ffc-9e5b-4cdd-b1a4-533b209d273d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.551500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba5ffc-9e5b-4cdd-b1a4-533b209d273d None admin] PATH_INFO: `/v3/groups/b9ebc1386d8b4215865047be50513efd` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.553143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba5ffc-9e5b-4cdd-b1a4-533b209d273d None admin] RBAC: Authorizing `identity:get_group(group_id=b9ebc1386d8b4215865047be50513efd)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:19.555205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba5ffc-9e5b-4cdd-b1a4-533b209d273d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:19.557864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 206/417] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:19 2022] GET /identity/v3/groups/b9ebc1386d8b4215865047be50513efd => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:19.558725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba5ffc-9e5b-4cdd-b1a4-533b209d273d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.601899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64048c0b-1712-4c96-bc5d-e4e4db30b57b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:19.602923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:19.644441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335d50-f05e-4dd9-b0d1-d75a624bf97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:19.645537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335d50-f05e-4dd9-b0d1-d75a624bf97d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.646199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335d50-f05e-4dd9-b0d1-d75a624bf97d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.646486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335d50-f05e-4dd9-b0d1-d75a624bf97d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.660623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5335d50-f05e-4dd9-b0d1-d75a624bf97d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d5335d50-f05e-4dd9-b0d1-d75a624bf97d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:19.670541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:19.671436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:19.672204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 212/418] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:19.673418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335d50-f05e-4dd9-b0d1-d75a624bf97d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.691411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:19.707225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba5ffc-9e5b-4cdd-b1a4-533b209d273d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:19.755373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29633c-da0a-4df7-86f3-32d9088c062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:19.756116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29633c-da0a-4df7-86f3-32d9088c062f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.756408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29633c-da0a-4df7-86f3-32d9088c062f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.756696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29633c-da0a-4df7-86f3-32d9088c062f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.770816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29633c-da0a-4df7-86f3-32d9088c062f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9d29633c-da0a-4df7-86f3-32d9088c062f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:19.782071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:19.783159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:19.783913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 207/419] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:19.784546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29633c-da0a-4df7-86f3-32d9088c062f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.804220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335d50-f05e-4dd9-b0d1-d75a624bf97d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:19.843263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d0232-8462-40df-bfa6-ea51ab40a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:19.844499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0232-8462-40df-bfa6-ea51ab40a851 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.844499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0232-8462-40df-bfa6-ea51ab40a851 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.844802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0232-8462-40df-bfa6-ea51ab40a851 None admin] PATH_INFO: `/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.846038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d0232-8462-40df-bfa6-ea51ab40a851 None admin] RBAC: Authorizing `identity:get_project(project_id=d3334aa68e9e41b9ae01ceb2502f9b38)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:19.847663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d0232-8462-40df-bfa6-ea51ab40a851 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:19.849471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 213/420] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:19 2022] GET /identity/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:19.850239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d0232-8462-40df-bfa6-ea51ab40a851 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.893498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:19.903990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29633c-da0a-4df7-86f3-32d9088c062f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:19.937434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:19.942188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:19.943263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.943739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:19.944159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:19.945054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:19.946268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:19.947840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:19.958142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 208/421] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:19.958627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d0232-8462-40df-bfa6-ea51ab40a851 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:19.959319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:19.998785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:19.999485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:19.999777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.000057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.000815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:20.001130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:20.003365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:20.016439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 214/422] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:20.018099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.069384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429dbd4-64eb-43cf-ab92-86c2473ca717 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:20.106026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb2128-c52c-4576-893b-1e0fce4a964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:20.107071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb2128-c52c-4576-893b-1e0fce4a964b None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.107361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb2128-c52c-4576-893b-1e0fce4a964b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.107706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb2128-c52c-4576-893b-1e0fce4a964b None admin] PATH_INFO: `/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38/groups/b9ebc1386d8b4215865047be50513efd/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.109800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb2128-c52c-4576-893b-1e0fce4a964b None admin] RBAC: Authorizing `identity:create_grant(project_id=d3334aa68e9e41b9ae01ceb2502f9b38, group_id=b9ebc1386d8b4215865047be50513efd, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:20.111987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb2128-c52c-4576-893b-1e0fce4a964b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:20.132433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 209/423] 10.222.0.72 () {58 vars in 1442 bytes} [Tue Jul 12 14:20:19 2022] PUT /identity/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38/groups/b9ebc1386d8b4215865047be50513efd/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:20.134030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb2128-c52c-4576-893b-1e0fce4a964b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.139829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df9d9-e7a9-4ae9-9b58-c69ca8fca2af None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:20.154467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:20.193654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1634f1-54cd-402d-b546-cf7db999d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:20.194796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1634f1-54cd-402d-b546-cf7db999d81e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.195236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1634f1-54cd-402d-b546-cf7db999d81e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.195678 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1634f1-54cd-402d-b546-cf7db999d81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.223819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:20.268539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb2128-c52c-4576-893b-1e0fce4a964b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:20.311026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b044d-0970-4ffb-957d-282df8d48954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:20.311926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b044d-0970-4ffb-957d-282df8d48954 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.312359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b044d-0970-4ffb-957d-282df8d48954 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.312804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b044d-0970-4ffb-957d-282df8d48954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.336562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1634f1-54cd-402d-b546-cf7db999d81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:20.338340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1634f1-54cd-402d-b546-cf7db999d81e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:20.415833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b044d-0970-4ffb-957d-282df8d48954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:20.417551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b044d-0970-4ffb-957d-282df8d48954 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:20.437781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:20.515655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 215/424] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:20.521199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1634f1-54cd-402d-b546-cf7db999d81e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.578904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 210/425] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:20.581008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2186-3056-4628-b250-f9aaf84581a2 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.581505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2186-3056-4628-b250-f9aaf84581a2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.581983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2186-3056-4628-b250-f9aaf84581a2 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.584323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 211/426] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:20.592142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eca29-26ad-4bdd-b619-862f81ec64cd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.592421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eca29-26ad-4bdd-b619-862f81ec64cd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.592704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eca29-26ad-4bdd-b619-862f81ec64cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.594938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:20.612845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-107eca29-26ad-4bdd-b619-862f81ec64cd None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:20.614118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-107eca29-26ad-4bdd-b619-862f81ec64cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:20.675301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1634f1-54cd-402d-b546-cf7db999d81e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:20.692130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 212/427] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:20.692994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eca29-26ad-4bdd-b619-862f81ec64cd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.735561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a21a9-f8f6-46e1-834d-5668c92f6f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:20.737002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a21a9-f8f6-46e1-834d-5668c92f6f3d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.737289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a21a9-f8f6-46e1-834d-5668c92f6f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.737568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a21a9-f8f6-46e1-834d-5668c92f6f3d None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.738828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a21a9-f8f6-46e1-834d-5668c92f6f3d None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:20.740398 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a21a9-f8f6-46e1-834d-5668c92f6f3d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:20.741887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:20.742453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 216/428] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:20.743364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a21a9-f8f6-46e1-834d-5668c92f6f3d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.811179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eca29-26ad-4bdd-b619-862f81ec64cd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:20.849102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c52d6-52a3-4845-9754-d2596d876d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:20.850153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c52d6-52a3-4845-9754-d2596d876d6f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.850546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c52d6-52a3-4845-9754-d2596d876d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.850923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c52d6-52a3-4845-9754-d2596d876d6f None admin] PATH_INFO: `/v3/projects/d0340b60166b4c069c60576799d26a32` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.852284 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c52d6-52a3-4845-9754-d2596d876d6f None admin] RBAC: Authorizing `identity:get_project(project_id=d0340b60166b4c069c60576799d26a32)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:20.853794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c52d6-52a3-4845-9754-d2596d876d6f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:20.855940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 213/429] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/projects/d0340b60166b4c069c60576799d26a32 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:20.856897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c52d6-52a3-4845-9754-d2596d876d6f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.865739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a21a9-f8f6-46e1-834d-5668c92f6f3d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:20.877953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:20.903936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7d991-a23d-4458-8910-44a94ff74194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:20.904794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7d991-a23d-4458-8910-44a94ff74194 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.905086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7d991-a23d-4458-8910-44a94ff74194 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.905370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7d991-a23d-4458-8910-44a94ff74194 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.917062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7d991-a23d-4458-8910-44a94ff74194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-63d7d991-a23d-4458-8910-44a94ff74194 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:20.925883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:20.926816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:20.927608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 217/430] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:20.928250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7d991-a23d-4458-8910-44a94ff74194 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.987835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c52d6-52a3-4845-9754-d2596d876d6f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.005022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:21.033389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf59b-53d3-4d00-bd91-08b6b47b7add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:21.035199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf59b-53d3-4d00-bd91-08b6b47b7add None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.035762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf59b-53d3-4d00-bd91-08b6b47b7add None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.036226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf59b-53d3-4d00-bd91-08b6b47b7add None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.038049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bf59b-53d3-4d00-bd91-08b6b47b7add None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:21.040100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bf59b-53d3-4d00-bd91-08b6b47b7add None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:21.042491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 214/431] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:21.049874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf59b-53d3-4d00-bd91-08b6b47b7add None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:21.052249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7d991-a23d-4458-8910-44a94ff74194 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.099943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1689-d204-4ea9-a981-27f689b0ed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:21.101349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1689-d204-4ea9-a981-27f689b0ed36 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.101641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1689-d204-4ea9-a981-27f689b0ed36 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.101924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1689-d204-4ea9-a981-27f689b0ed36 None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.103638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c1689-d204-4ea9-a981-27f689b0ed36 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:21.105849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c1689-d204-4ea9-a981-27f689b0ed36 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:21.108721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 218/432] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:21.109675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1689-d204-4ea9-a981-27f689b0ed36 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:21.167527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:21.171270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf59b-53d3-4d00-bd91-08b6b47b7add None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.216753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:21.217704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.218097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.218506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.219412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:21.219861 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:21.222022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:21.236216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 215/433] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:21.237587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:21.239937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1689-d204-4ea9-a981-27f689b0ed36 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.280118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:21.281053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.281595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.281875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.282707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] RBAC: Adding query filter params (group.id=2ef89f293c254e099f612f37a7dbcb04, role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=d0340b60166b4c069c60576799d26a32) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:21.282850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:21.283083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:21.285067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:21.294824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 219/434] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:21 2022] GET /identity/v3/role_assignments?group.id=2ef89f293c254e099f612f37a7dbcb04&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:21.294824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:21.371157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c97ce7-8cb1-46aa-9239-9fb191ce7e9c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.410048 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05f9bb-ffa7-4d05-b932-6d380f212015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:21.411233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05f9bb-ffa7-4d05-b932-6d380f212015 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.411687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05f9bb-ffa7-4d05-b932-6d380f212015 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.412110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05f9bb-ffa7-4d05-b932-6d380f212015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.413109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05f9bb-ffa7-4d05-b932-6d380f212015 None admin] RBAC: Adding query filter params (group.id=2ef89f293c254e099f612f37a7dbcb04, role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=d0340b60166b4c069c60576799d26a32) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:21.413675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05f9bb-ffa7-4d05-b932-6d380f212015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:21.415476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05f9bb-ffa7-4d05-b932-6d380f212015 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:21.416504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b219f6f-bb4c-4ac1-8cb8-24c4684b4ace None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.420495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:21.423346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 216/435] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:21 2022] GET /identity/v3/role_assignments?group.id=2ef89f293c254e099f612f37a7dbcb04&scope.project.id=d0340b60166b4c069c60576799d26a32&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:21.425615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f59b4-c4e7-4464-9a33-ffa501ba5d66 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.426090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f59b4-c4e7-4464-9a33-ffa501ba5d66 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.426516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f59b4-c4e7-4464-9a33-ffa501ba5d66 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.428332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 217/436] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:21.440682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3578fc-1e80-4a91-9f1a-e4c3ff281ebc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.440978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3578fc-1e80-4a91-9f1a-e4c3ff281ebc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.441263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3578fc-1e80-4a91-9f1a-e4c3ff281ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.473215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bf3578fc-1e80-4a91-9f1a-e4c3ff281ebc None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:21.474496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bf3578fc-1e80-4a91-9f1a-e4c3ff281ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:21.479449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6c3fc-268f-40cd-8860-197ca9462064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:21.480243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c3fc-268f-40cd-8860-197ca9462064 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.480603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c3fc-268f-40cd-8860-197ca9462064 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.480960 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c3fc-268f-40cd-8860-197ca9462064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.572726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6c3fc-268f-40cd-8860-197ca9462064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:21.574230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6c3fc-268f-40cd-8860-197ca9462064 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:21.581167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 218/437] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:21.609991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3578fc-1e80-4a91-9f1a-e4c3ff281ebc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:21.654805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:21.716600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 220/438] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:21.722635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6c3fc-268f-40cd-8860-197ca9462064 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:21.724930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:21.751070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3578fc-1e80-4a91-9f1a-e4c3ff281ebc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.795278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8065dd-6e5c-46b1-ac85-aba108fddd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:21.796100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8065dd-6e5c-46b1-ac85-aba108fddd24 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.796384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8065dd-6e5c-46b1-ac85-aba108fddd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.796658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8065dd-6e5c-46b1-ac85-aba108fddd24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.809274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8065dd-6e5c-46b1-ac85-aba108fddd24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ef8065dd-6e5c-46b1-ac85-aba108fddd24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:21.819638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:21.820525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:21.821738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 219/439] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:21.829225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8065dd-6e5c-46b1-ac85-aba108fddd24 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:21.853793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6c3fc-268f-40cd-8860-197ca9462064 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.897633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de73a-3a9e-432b-ba5a-b1b5317676e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:21.898515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de73a-3a9e-432b-ba5a-b1b5317676e6 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:21.899462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de73a-3a9e-432b-ba5a-b1b5317676e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:21.899462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de73a-3a9e-432b-ba5a-b1b5317676e6 None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:21.900473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55de73a-3a9e-432b-ba5a-b1b5317676e6 None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:21.902560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55de73a-3a9e-432b-ba5a-b1b5317676e6 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:21.905474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 221/440] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:21 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:21.912211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de73a-3a9e-432b-ba5a-b1b5317676e6 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:21.944499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:21.953995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8065dd-6e5c-46b1-ac85-aba108fddd24 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:21.999708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.000491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.001156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.001156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.001795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:22.003420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.004919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.005385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.014370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 220/441] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:22.020597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.048324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de73a-3a9e-432b-ba5a-b1b5317676e6 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.092041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc45d4-ef98-4e21-b2df-a426d203af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.092920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc45d4-ef98-4e21-b2df-a426d203af0c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.093208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc45d4-ef98-4e21-b2df-a426d203af0c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.093515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc45d4-ef98-4e21-b2df-a426d203af0c None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.096169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc45d4-ef98-4e21-b2df-a426d203af0c None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.097800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc45d4-ef98-4e21-b2df-a426d203af0c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.100574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 222/442] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:21 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:22.106193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc45d4-ef98-4e21-b2df-a426d203af0c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.155709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11246211-015c-40fe-8981-df9f6bc14f14 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.194028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de57f3-cee1-43ac-92b3-5f352d1f4a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.194688 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de57f3-cee1-43ac-92b3-5f352d1f4a83 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.195009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de57f3-cee1-43ac-92b3-5f352d1f4a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.195288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de57f3-cee1-43ac-92b3-5f352d1f4a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.221285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.224239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc45d4-ef98-4e21-b2df-a426d203af0c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.258727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef69f-3171-4ebe-8634-66b6e7d97c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.259406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef69f-3171-4ebe-8634-66b6e7d97c9a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.259698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef69f-3171-4ebe-8634-66b6e7d97c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.259979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef69f-3171-4ebe-8634-66b6e7d97c9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.260801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef69f-3171-4ebe-8634-66b6e7d97c9a None admin] RBAC: Adding query filter params (group.id=2ef89f293c254e099f612f37a7dbcb04, role.id=36219e61b6d84e06b7585b5dca9f1c95, scope.project.id=312f010075904c318a115286ea12a499) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:22.261118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef69f-3171-4ebe-8634-66b6e7d97c9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.262559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef69f-3171-4ebe-8634-66b6e7d97c9a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.266904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de57f3-cee1-43ac-92b3-5f352d1f4a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.269030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 223/443] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/role_assignments?group.id=2ef89f293c254e099f612f37a7dbcb04&scope.project.id=312f010075904c318a115286ea12a499&role.id=36219e61b6d84e06b7585b5dca9f1c95 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:22.269163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de57f3-cee1-43ac-92b3-5f352d1f4a83 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.309967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242ecf-08b7-4182-b504-cdf4875dd022 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.310276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242ecf-08b7-4182-b504-cdf4875dd022 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.310542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242ecf-08b7-4182-b504-cdf4875dd022 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.312113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 224/444] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:22.318209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797f96-a7a3-49e1-a181-c21e7926609b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.318509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797f96-a7a3-49e1-a181-c21e7926609b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.318814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797f96-a7a3-49e1-a181-c21e7926609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.324044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.338318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f5797f96-a7a3-49e1-a181-c21e7926609b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:22.339606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f5797f96-a7a3-49e1-a181-c21e7926609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:22.386825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 221/445] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:20:22.388443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de57f3-cee1-43ac-92b3-5f352d1f4a83 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.416853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 225/446] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:22.440961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5797f96-a7a3-49e1-a181-c21e7926609b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.471622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.520931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de57f3-cee1-43ac-92b3-5f352d1f4a83 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.559967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bde7e9-76ca-4641-94f4-1606d4a513ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.560843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bde7e9-76ca-4641-94f4-1606d4a513ff None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.561125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bde7e9-76ca-4641-94f4-1606d4a513ff None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.561402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bde7e9-76ca-4641-94f4-1606d4a513ff None admin] PATH_INFO: `/v3/projects/312f010075904c318a115286ea12a499` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.562604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bde7e9-76ca-4641-94f4-1606d4a513ff None admin] RBAC: Authorizing `identity:get_project(project_id=312f010075904c318a115286ea12a499)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.564071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bde7e9-76ca-4641-94f4-1606d4a513ff None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.564231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5797f96-a7a3-49e1-a181-c21e7926609b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.566351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 222/447] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/projects/312f010075904c318a115286ea12a499 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:22.571902 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bde7e9-76ca-4641-94f4-1606d4a513ff None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.600181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.606957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33671ce5-4dfe-4311-917c-70a95baebb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.608193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671ce5-4dfe-4311-917c-70a95baebb81 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.608771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671ce5-4dfe-4311-917c-70a95baebb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.609191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671ce5-4dfe-4311-917c-70a95baebb81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.621486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33671ce5-4dfe-4311-917c-70a95baebb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-33671ce5-4dfe-4311-917c-70a95baebb81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:22.629870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:22.630999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:22.631970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:22.632556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 226/448] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:22.638171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33671ce5-4dfe-4311-917c-70a95baebb81 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.693297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bde7e9-76ca-4641-94f4-1606d4a513ff None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.716510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.728082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6652b-b8b2-4d42-a3d3-5db0e3283080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.728947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6652b-b8b2-4d42-a3d3-5db0e3283080 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.729233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6652b-b8b2-4d42-a3d3-5db0e3283080 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.729515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6652b-b8b2-4d42-a3d3-5db0e3283080 None admin] PATH_INFO: `/v3/groups/2ef89f293c254e099f612f37a7dbcb04` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.730699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6652b-b8b2-4d42-a3d3-5db0e3283080 None admin] RBAC: Authorizing `identity:get_group(group_id=2ef89f293c254e099f612f37a7dbcb04)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.732186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6652b-b8b2-4d42-a3d3-5db0e3283080 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.733837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 223/449] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/groups/2ef89f293c254e099f612f37a7dbcb04 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:22.740092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6652b-b8b2-4d42-a3d3-5db0e3283080 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.740490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33671ce5-4dfe-4311-917c-70a95baebb81 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.773341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.774009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.774294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.774572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.775354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:22.775664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.777046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.785713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 227/450] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:22.791209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.838185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6652b-b8b2-4d42-a3d3-5db0e3283080 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.844002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.871358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.872015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.872300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.872580 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.873407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] RBAC: Adding query filter params (group.id=2ef89f293c254e099f612f37a7dbcb04, role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=312f010075904c318a115286ea12a499) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:22.873724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.875178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.881036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 224/451] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/role_assignments?group.id=2ef89f293c254e099f612f37a7dbcb04&scope.project.id=312f010075904c318a115286ea12a499&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:22.887689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0d070-2d96-4735-a7e3-8b4032f4c820 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.923794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9dca7-5831-4813-b473-447679de65a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.925100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9dca7-5831-4813-b473-447679de65a6 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.925382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9dca7-5831-4813-b473-447679de65a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.925657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9dca7-5831-4813-b473-447679de65a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.995612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9dca7-5831-4813-b473-447679de65a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.997002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9dca7-5831-4813-b473-447679de65a6 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.054894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:23.101318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 228/452] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:20:23.107068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:23.164595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:23.209030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ca400-0bbe-442e-9867-7de7abe77a64 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:23.241971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bba72-388c-4075-bff6-437590d7882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:23.242865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bba72-388c-4075-bff6-437590d7882a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:23.243152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bba72-388c-4075-bff6-437590d7882a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:23.243432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bba72-388c-4075-bff6-437590d7882a None admin] PATH_INFO: `/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:23.244596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bba72-388c-4075-bff6-437590d7882a None admin] RBAC: Authorizing `identity:get_project(project_id=d3334aa68e9e41b9ae01ceb2502f9b38)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:23.246076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bba72-388c-4075-bff6-437590d7882a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.247738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 225/453] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:23 2022] GET /identity/v3/projects/d3334aa68e9e41b9ae01ceb2502f9b38 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:23.253337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9dca7-5831-4813-b473-447679de65a6 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:23.349221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9dca7-5831-4813-b473-447679de65a6 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:23.380937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfed35-ee1b-4242-95d6-eb0d2fec5b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:23.381793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfed35-ee1b-4242-95d6-eb0d2fec5b0d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:23.382081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfed35-ee1b-4242-95d6-eb0d2fec5b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:23.382362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfed35-ee1b-4242-95d6-eb0d2fec5b0d None admin] PATH_INFO: `/v3/groups/b9ebc1386d8b4215865047be50513efd` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:23.383546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfed35-ee1b-4242-95d6-eb0d2fec5b0d None admin] RBAC: Authorizing `identity:get_group(group_id=b9ebc1386d8b4215865047be50513efd)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:23.384991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfed35-ee1b-4242-95d6-eb0d2fec5b0d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.386582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 229/454] 10.222.0.72 () {56 vars in 1180 bytes} [Tue Jul 12 14:20:23 2022] GET /identity/v3/groups/b9ebc1386d8b4215865047be50513efd => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:23.392250 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bba72-388c-4075-bff6-437590d7882a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:23.488917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bba72-388c-4075-bff6-437590d7882a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:23.511233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:23.522428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948c90b-3ab0-4bdf-8c11-4023d9ba492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:23.523111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c90b-3ab0-4bdf-8c11-4023d9ba492a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:23.523403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c90b-3ab0-4bdf-8c11-4023d9ba492a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:23.523687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c90b-3ab0-4bdf-8c11-4023d9ba492a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:23.524513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948c90b-3ab0-4bdf-8c11-4023d9ba492a None admin] RBAC: Adding query filter params (group.id=b9ebc1386d8b4215865047be50513efd, role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d3334aa68e9e41b9ae01ceb2502f9b38) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:23.524829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948c90b-3ab0-4bdf-8c11-4023d9ba492a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:23.526257 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948c90b-3ab0-4bdf-8c11-4023d9ba492a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.532143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 226/455] 10.222.0.72 () {56 vars in 1376 bytes} [Tue Jul 12 14:20:23 2022] GET /identity/v3/role_assignments?group.id=b9ebc1386d8b4215865047be50513efd&scope.project.id=d3334aa68e9e41b9ae01ceb2502f9b38&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:26.001932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e749e-ccbb-4427-baa7-18f7d565a186 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.003039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e749e-ccbb-4427-baa7-18f7d565a186 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.003039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e749e-ccbb-4427-baa7-18f7d565a186 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.004673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 230/456] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:26.010065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945b36-5575-44ba-a67c-50f7bc8c4a94 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.010470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945b36-5575-44ba-a67c-50f7bc8c4a94 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.010688 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945b36-5575-44ba-a67c-50f7bc8c4a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.035792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-94945b36-5575-44ba-a67c-50f7bc8c4a94 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:26.037067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-94945b36-5575-44ba-a67c-50f7bc8c4a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:26.132121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 227/457] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:26.161956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4695-0d6d-4475-8104-a39577374438 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.162260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4695-0d6d-4475-8104-a39577374438 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.162535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4695-0d6d-4475-8104-a39577374438 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.163940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 231/458] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:26.166185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94945b36-5575-44ba-a67c-50f7bc8c4a94 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.172108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2940f0-2a23-4b34-9b28-c09589d71ea9 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.172409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2940f0-2a23-4b34-9b28-c09589d71ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.172704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2940f0-2a23-4b34-9b28-c09589d71ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.201273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ce2940f0-2a23-4b34-9b28-c09589d71ea9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:26.202481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ce2940f0-2a23-4b34-9b28-c09589d71ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:26.243138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.318739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 232/459] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:26.343122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2940f0-2a23-4b34-9b28-c09589d71ea9 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.365774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94945b36-5575-44ba-a67c-50f7bc8c4a94 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.399910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.422926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75df81-3b26-4396-8ecd-b8c63a021d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.424670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75df81-3b26-4396-8ecd-b8c63a021d10 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.425142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75df81-3b26-4396-8ecd-b8c63a021d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.425597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75df81-3b26-4396-8ecd-b8c63a021d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.441086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75df81-3b26-4396-8ecd-b8c63a021d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.443478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75df81-3b26-4396-8ecd-b8c63a021d10 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.453427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2940f0-2a23-4b34-9b28-c09589d71ea9 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1e75df81-3b26-4396-8ecd-b8c63a021d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:26.463739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:26.464594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:26.465398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:26.465398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:26.465398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:26.465398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:26.465398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 228/460] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:26.466478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610adbc-99ea-4a91-be1d-6a3c03c8cccc None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.466765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610adbc-99ea-4a91-be1d-6a3c03c8cccc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.472316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610adbc-99ea-4a91-be1d-6a3c03c8cccc None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.473772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 229/461] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:26.478212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610adbc-99ea-4a91-be1d-6a3c03c8cccc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.510730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c55cc2-0ddb-4015-b736-f879e565b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.510730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c55cc2-0ddb-4015-b736-f879e565b5cb None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.510730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c55cc2-0ddb-4015-b736-f879e565b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.510730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c55cc2-0ddb-4015-b736-f879e565b5cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.523324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c55cc2-0ddb-4015-b736-f879e565b5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.525205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c55cc2-0ddb-4015-b736-f879e565b5cb None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-54c55cc2-0ddb-4015-b736-f879e565b5cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:26.547561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:26.548479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:26.549316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:26.549316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:26.549316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:26.549316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:26.553937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 233/462] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:26.555299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d582d-7749-4174-b8e4-a4f0e5596b40 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.555660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d582d-7749-4174-b8e4-a4f0e5596b40 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.556015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d582d-7749-4174-b8e4-a4f0e5596b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.561815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.578329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7b4d582d-7749-4174-b8e4-a4f0e5596b40 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:26.579503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7b4d582d-7749-4174-b8e4-a4f0e5596b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:26.597733 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610adbc-99ea-4a91-be1d-6a3c03c8cccc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.646025 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.648097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.648581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.649076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.650057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:26.650585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.651492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 234/463] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:26.652149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d582d-7749-4174-b8e4-a4f0e5596b40 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.652924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.668982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 230/464] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:26.679405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.725002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.781730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d582d-7749-4174-b8e4-a4f0e5596b40 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.809843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607e3d0-835c-486f-af52-a497b4dba24f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.818852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.820148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.820617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.821473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.822651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:26.823133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.825232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.827448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.839549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 235/465] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:26.840614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.849339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829ca40-3596-4591-973d-6a8eda54490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.850025 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ca40-3596-4591-973d-6a8eda54490c None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.850318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ca40-3596-4591-973d-6a8eda54490c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.850600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ca40-3596-4591-973d-6a8eda54490c None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.851335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829ca40-3596-4591-973d-6a8eda54490c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.852766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829ca40-3596-4591-973d-6a8eda54490c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.874574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 231/466] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:26.874574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88452c4e-10a6-4fa7-8d4d-f6f7a3a5d0f6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.874574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88452c4e-10a6-4fa7-8d4d-f6f7a3a5d0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.874574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88452c4e-10a6-4fa7-8d4d-f6f7a3a5d0f6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.874574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 232/467] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:26.874574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88452c4e-10a6-4fa7-8d4d-f6f7a3a5d0f6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.987530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395d4b9-0701-425c-a30d-5344316e7342 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.011086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.035334 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc47f27-727a-47c6-815e-702a18bd6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.036333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc47f27-727a-47c6-815e-702a18bd6d26 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.036628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc47f27-727a-47c6-815e-702a18bd6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.036907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc47f27-727a-47c6-815e-702a18bd6d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.038393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88452c4e-10a6-4fa7-8d4d-f6f7a3a5d0f6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.053109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc47f27-727a-47c6-815e-702a18bd6d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.056037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc47f27-727a-47c6-815e-702a18bd6d26 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-adc47f27-727a-47c6-815e-702a18bd6d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:27.080009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:27.081090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:27.081940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:27.081940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:27.081940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:27.081940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:27.081940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 236/468] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:27.082628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0147-73e7-41fd-b2c6-00fad88fc837 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.082749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0147-73e7-41fd-b2c6-00fad88fc837 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.083073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0147-73e7-41fd-b2c6-00fad88fc837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.101982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-efff0147-73e7-41fd-b2c6-00fad88fc837 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:27.103937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39538b-fb45-4be3-9615-1bca4b62d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.104119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-efff0147-73e7-41fd-b2c6-00fad88fc837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:27.105319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39538b-fb45-4be3-9615-1bca4b62d224 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.105952 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39538b-fb45-4be3-9615-1bca4b62d224 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.106587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39538b-fb45-4be3-9615-1bca4b62d224 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.107924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39538b-fb45-4be3-9615-1bca4b62d224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.110253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39538b-fb45-4be3-9615-1bca4b62d224 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.139120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 233/469] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:27.140374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39538b-fb45-4be3-9615-1bca4b62d224 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.153972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.184933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 237/470] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:27.211624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff0147-73e7-41fd-b2c6-00fad88fc837 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.263418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39538b-fb45-4be3-9615-1bca4b62d224 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.301984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbabde6-c738-4785-868a-22d8080a3cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.302683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabde6-c738-4785-868a-22d8080a3cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.303008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabde6-c738-4785-868a-22d8080a3cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.303295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabde6-c738-4785-868a-22d8080a3cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.304049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbabde6-c738-4785-868a-22d8080a3cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:27.304364 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbabde6-c738-4785-868a-22d8080a3cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.305803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbabde6-c738-4785-868a-22d8080a3cd4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.319097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 234/471] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:27.322477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615370-044c-4a1f-99cb-0166ecd580dd None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.322797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615370-044c-4a1f-99cb-0166ecd580dd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.323100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615370-044c-4a1f-99cb-0166ecd580dd None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.324894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 235/472] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:27.326229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615370-044c-4a1f-99cb-0166ecd580dd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.329299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.422531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff0147-73e7-41fd-b2c6-00fad88fc837 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.457027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615370-044c-4a1f-99cb-0166ecd580dd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.470168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4f4b0-d447-4306-af2b-924d79ea3033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.471659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4b0-d447-4306-af2b-924d79ea3033 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.472252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4b0-d447-4306-af2b-924d79ea3033 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.472558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4b0-d447-4306-af2b-924d79ea3033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.484918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4f4b0-d447-4306-af2b-924d79ea3033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.487441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4f4b0-d447-4306-af2b-924d79ea3033 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.501126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d422df-7bdf-4ea6-a97e-86642be1c813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.502142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d422df-7bdf-4ea6-a97e-86642be1c813 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.502665 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d422df-7bdf-4ea6-a97e-86642be1c813 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.503271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d422df-7bdf-4ea6-a97e-86642be1c813 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.504543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d422df-7bdf-4ea6-a97e-86642be1c813 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-03d4f4b0-d447-4306-af2b-924d79ea3033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:27.507160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:27.508582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:27.509660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:27.509660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:27.509660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:27.509660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:27.509660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 238/473] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:27.510192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d422df-7bdf-4ea6-a97e-86642be1c813 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.511250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1dc06-5256-4b14-b622-c331f303a6dd None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.511637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1dc06-5256-4b14-b622-c331f303a6dd None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.512012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1dc06-5256-4b14-b622-c331f303a6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.530980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a9e1dc06-5256-4b14-b622-c331f303a6dd None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:27.532626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a9e1dc06-5256-4b14-b622-c331f303a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:27.540248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 236/474] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:20:27.541351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d422df-7bdf-4ea6-a97e-86642be1c813 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.559662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.609773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 239/475] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:27.618573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.660377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1dc06-5256-4b14-b622-c331f303a6dd None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.678308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d422df-7bdf-4ea6-a97e-86642be1c813 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.726224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.727579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.727878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.728149 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.728895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:27.729212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.730877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.750839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 237/476] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:27.754200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.825392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1dc06-5256-4b14-b622-c331f303a6dd None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.871763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.872448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.872740 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.873022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.873775 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.875200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.881831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.sql.core [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 14:20:27.881831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 14:20:27.881831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [parameters: {'id': '35197eed6c174992b0ebbebd3c6c1930', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 14:20:27.881831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80444) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 14:20:27.896259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27404b6-7902-4ede-aa37-0c394d1b92a3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result.read() Jul 12 14:20:27.903534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:20:27.905864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application yield resource Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise self.value Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application session.commit() Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 14:20:27.907311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.session.flush() Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application compat.raise_( Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 14:20:27.908184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:20:27.909689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result.read() Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:20:27.910816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [parameters: {'id': '35197eed6c174992b0ebbebd3c6c1930', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:27.911588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 14:20:27.912350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:27.913216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 240/477] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/roles => generated 144 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:27.913216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.928498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.947610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.959646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caafb12-84a2-4955-882a-a598f34cdfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.961180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caafb12-84a2-4955-882a-a598f34cdfef None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.961618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caafb12-84a2-4955-882a-a598f34cdfef None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.962069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caafb12-84a2-4955-882a-a598f34cdfef None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.962956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caafb12-84a2-4955-882a-a598f34cdfef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.965730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caafb12-84a2-4955-882a-a598f34cdfef None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.994004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 238/478] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/users => generated 249 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:28.049789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da363b05-7c38-41f6-918d-b283e07d92c3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:28.090616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efbf45-14c9-4198-88e3-5b77d808176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:28.091598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efbf45-14c9-4198-88e3-5b77d808176a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:28.092264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efbf45-14c9-4198-88e3-5b77d808176a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:28.092552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efbf45-14c9-4198-88e3-5b77d808176a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:28.106109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efbf45-14c9-4198-88e3-5b77d808176a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-15efbf45-14c9-4198-88e3-5b77d808176a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:28.114668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:28.115617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:28.116670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 241/479] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:28.121659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caafb12-84a2-4955-882a-a598f34cdfef None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:28.251490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caafb12-84a2-4955-882a-a598f34cdfef None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:28.290612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c991344-1abb-4a66-8926-2f9ab4bf3713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:28.291604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991344-1abb-4a66-8926-2f9ab4bf3713 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:28.292074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991344-1abb-4a66-8926-2f9ab4bf3713 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:28.292529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991344-1abb-4a66-8926-2f9ab4bf3713 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:28.293480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c991344-1abb-4a66-8926-2f9ab4bf3713 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:28.293965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c991344-1abb-4a66-8926-2f9ab4bf3713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:28.295546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c991344-1abb-4a66-8926-2f9ab4bf3713 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:28.304587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 239/480] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:29.568926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0698c-e021-4a59-8f97-04e0294d8f41 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:29.569471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0698c-e021-4a59-8f97-04e0294d8f41 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:29.569471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0698c-e021-4a59-8f97-04e0294d8f41 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:29.571140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 242/481] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:29.576280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aede4c-ef19-433f-8159-1290f4cd27d5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:29.576763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aede4c-ef19-433f-8159-1290f4cd27d5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:29.576865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aede4c-ef19-433f-8159-1290f4cd27d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:29.600700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a0aede4c-ef19-433f-8159-1290f4cd27d5 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:29.601903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a0aede4c-ef19-433f-8159-1290f4cd27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:29.640059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:29.667649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3eec-9764-4abf-ad35-9827d4413c90 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:29.667945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3eec-9764-4abf-ad35-9827d4413c90 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:29.668215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3eec-9764-4abf-ad35-9827d4413c90 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:29.669839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 243/482] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:29.676041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff5acf-4ad8-4ba5-87d0-84fd1e5ee2e6 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:29.676341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff5acf-4ad8-4ba5-87d0-84fd1e5ee2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:29.676629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff5acf-4ad8-4ba5-87d0-84fd1e5ee2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:29.700894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-31ff5acf-4ad8-4ba5-87d0-84fd1e5ee2e6 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:29.703003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 240/483] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:29.704424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-31ff5acf-4ad8-4ba5-87d0-84fd1e5ee2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:29.738393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aede4c-ef19-433f-8159-1290f4cd27d5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:29.808080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 244/484] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:29.883177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aede4c-ef19-433f-8159-1290f4cd27d5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:29.905321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff5acf-4ad8-4ba5-87d0-84fd1e5ee2e6 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:29.927149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:29.946248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab848e7d-6b25-4b05-9c11-bafe1c9b80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:29.948546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab848e7d-6b25-4b05-9c11-bafe1c9b80f2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:29.949303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab848e7d-6b25-4b05-9c11-bafe1c9b80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:29.951294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab848e7d-6b25-4b05-9c11-bafe1c9b80f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:29.976158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab848e7d-6b25-4b05-9c11-bafe1c9b80f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ab848e7d-6b25-4b05-9c11-bafe1c9b80f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:29.984646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:29.985504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:29.986272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:29.995303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 241/485] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:30.001917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab848e7d-6b25-4b05-9c11-bafe1c9b80f2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.055159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.077598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff5acf-4ad8-4ba5-87d0-84fd1e5ee2e6 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.139480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bd665-1d74-4c5f-90b0-8a869718a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.140729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd665-1d74-4c5f-90b0-8a869718a51b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.141021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd665-1d74-4c5f-90b0-8a869718a51b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.141302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd665-1d74-4c5f-90b0-8a869718a51b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.155091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bd665-1d74-4c5f-90b0-8a869718a51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-065bd665-1d74-4c5f-90b0-8a869718a51b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:30.165754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:30.166616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:30.167434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:30.168014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 245/486] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:30.169231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ef88-9a74-47f7-9a86-f786707279df None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.169530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ef88-9a74-47f7-9a86-f786707279df None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.169810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ef88-9a74-47f7-9a86-f786707279df None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.171105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 246/487] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:30.175752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579ef88-9a74-47f7-9a86-f786707279df None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.181393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab848e7d-6b25-4b05-9c11-bafe1c9b80f2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.216745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793d783-240f-4c19-bd85-4993ed78dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.217430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d783-240f-4c19-bd85-4993ed78dc21 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.217722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d783-240f-4c19-bd85-4993ed78dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.218005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d783-240f-4c19-bd85-4993ed78dc21 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.218762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793d783-240f-4c19-bd85-4993ed78dc21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:30.219101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793d783-240f-4c19-bd85-4993ed78dc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.220491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793d783-240f-4c19-bd85-4993ed78dc21 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.230024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 242/488] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:30.231372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842172b8-8553-444d-8fef-cf8c14699d79 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.231675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842172b8-8553-444d-8fef-cf8c14699d79 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.231962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842172b8-8553-444d-8fef-cf8c14699d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.249098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-842172b8-8553-444d-8fef-cf8c14699d79 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:30.250311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-842172b8-8553-444d-8fef-cf8c14699d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:30.263149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.304673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579ef88-9a74-47f7-9a86-f786707279df None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.325080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 243/489] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:30.325938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842172b8-8553-444d-8fef-cf8c14699d79 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.358479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.362667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.363907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.364198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.364483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.365247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:30.365560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.367181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.376494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 247/490] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:30.382287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.465186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842172b8-8553-444d-8fef-cf8c14699d79 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.491576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cca0a9-3430-41fd-be24-bb844a8f347f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.510054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.511197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.511486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.511766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.525981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.527635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.528927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d501dba-3739-4631-934e-429f40cfcc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.529996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d501dba-3739-4631-934e-429f40cfcc90 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.530460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d501dba-3739-4631-934e-429f40cfcc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.530896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d501dba-3739-4631-934e-429f40cfcc90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.533168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.545204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d501dba-3739-4631-934e-429f40cfcc90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:30.548244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:30.549240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:30.551669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:30.551669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:30.551669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:30.551669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:30.551669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 244/491] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:30.551669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-2d501dba-3739-4631-934e-429f40cfcc90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:30.556418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:30.558196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 248/492] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:30.560263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d501dba-3739-4631-934e-429f40cfcc90 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.637657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.673092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1929688-03ff-4b17-8704-d427bab89720 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.701742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d501dba-3739-4631-934e-429f40cfcc90 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.708486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.709289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.709587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.709871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.723380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.724783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.738099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92a200-7259-4495-ac41-008367700281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.738797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92a200-7259-4495-ac41-008367700281 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.739088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92a200-7259-4495-ac41-008367700281 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.739370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92a200-7259-4495-ac41-008367700281 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.740095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92a200-7259-4495-ac41-008367700281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:30.740407 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92a200-7259-4495-ac41-008367700281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.741783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92a200-7259-4495-ac41-008367700281 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:30.741965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:30.742743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:30.743594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:30.743594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:30.743594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:30.743594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:30.743594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 245/493] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:30.744582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.763564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 249/494] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:30.763564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af66f-8282-4535-9db4-56164cbcb2aa None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.763564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af66f-8282-4535-9db4-56164cbcb2aa None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.763564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af66f-8282-4535-9db4-56164cbcb2aa None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.763564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 250/495] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:30.763564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af66f-8282-4535-9db4-56164cbcb2aa None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.825929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.863367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb15b-63c3-4d70-91b3-fb4d68b87cde None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.875265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af66f-8282-4535-9db4-56164cbcb2aa None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.886041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.899542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.900219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.900515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.900802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.901561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:30.901877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.903299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.916762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 246/496] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:30.916762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.918636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba277834-16ce-474e-b9b5-d10064ff6f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.919342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba277834-16ce-474e-b9b5-d10064ff6f7e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.919637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba277834-16ce-474e-b9b5-d10064ff6f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.920066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba277834-16ce-474e-b9b5-d10064ff6f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.920629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba277834-16ce-474e-b9b5-d10064ff6f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:30.920937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba277834-16ce-474e-b9b5-d10064ff6f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.922326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba277834-16ce-474e-b9b5-d10064ff6f7e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.933867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 251/497] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:30.935222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac2183-7676-4002-9ca9-dd3ec70ce62c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.935575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac2183-7676-4002-9ca9-dd3ec70ce62c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.935936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac2183-7676-4002-9ca9-dd3ec70ce62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.952029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e6ac2183-7676-4002-9ca9-dd3ec70ce62c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:30.953210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e6ac2183-7676-4002-9ca9-dd3ec70ce62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:31.014928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3780d2-7be5-414d-acc2-ebc73e82011c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.019248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 252/498] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:31.020540 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e42c-602a-411f-b669-83dbf1aafb4a None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.020833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e42c-602a-411f-b669-83dbf1aafb4a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.021106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e42c-602a-411f-b669-83dbf1aafb4a None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.022632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 253/499] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:31.023365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e42c-602a-411f-b669-83dbf1aafb4a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.054462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.055297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.055586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.055869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.063944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.065939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.071361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:31.081957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:31.082873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:31.083763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 247/500] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:31.084309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.127049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e42c-602a-411f-b669-83dbf1aafb4a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.129173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:31.162957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180fe18-a408-4c2e-b36c-75a822531ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.163751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fe18-a408-4c2e-b36c-75a822531ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.164034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fe18-a408-4c2e-b36c-75a822531ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.164314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fe18-a408-4c2e-b36c-75a822531ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.173989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180fe18-a408-4c2e-b36c-75a822531ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.175501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180fe18-a408-4c2e-b36c-75a822531ef2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.184506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142ce4-8cfd-498b-9f88-c5de86663f8b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-e180fe18-a408-4c2e-b36c-75a822531ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:31.193222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:31.194205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:31.195271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:31.195271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:31.195271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:31.195271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:31.195271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 254/501] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:31.195976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70ab1d-7a0c-4e04-a88a-11db4cad0d34 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.195976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70ab1d-7a0c-4e04-a88a-11db4cad0d34 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.196108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70ab1d-7a0c-4e04-a88a-11db4cad0d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.213033 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ba70ab1d-7a0c-4e04-a88a-11db4cad0d34 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:31.214231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ba70ab1d-7a0c-4e04-a88a-11db4cad0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:31.221510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.222310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.222597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.222920 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.230235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.231707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:31.245549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:31.246416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:31.247329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 248/502] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:31.248410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.282477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 255/503] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:31.283274 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70ab1d-7a0c-4e04-a88a-11db4cad0d34 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.313382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:31.355102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aeec9-9216-4598-833b-43442793b69c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.357382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:31.386091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70ab1d-7a0c-4e04-a88a-11db4cad0d34 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.389170 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317abb-e33e-4d78-b2f8-ad01f54e36fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.389966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317abb-e33e-4d78-b2f8-ad01f54e36fa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.390249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317abb-e33e-4d78-b2f8-ad01f54e36fa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.390530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317abb-e33e-4d78-b2f8-ad01f54e36fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.400732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3317abb-e33e-4d78-b2f8-ad01f54e36fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a3317abb-e33e-4d78-b2f8-ad01f54e36fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:31.408696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:31.409537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:31.410331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 249/504] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:31.411000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317abb-e33e-4d78-b2f8-ad01f54e36fa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.422915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.423586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.423867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.424141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.425747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:31.426061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.427510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.464074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 256/505] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:31.464881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.512703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317abb-e33e-4d78-b2f8-ad01f54e36fa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.545357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.545943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.546230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.546510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.547264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:31.547356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:31.547576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.548964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.560994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 250/506] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:31.561933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.564010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889b5b8-92c8-4396-9648-1552e043bf38 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.586940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:31.600784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.601456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.601741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.602018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.602905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:31.603215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.604657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.621413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 257/507] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:31.622186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.665294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12515876-2f2e-4adf-9a0e-8b7e15d2881a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.699102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.699889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.700175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.700455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.710450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.711934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.718363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef0555-8efe-4b1e-9704-b177cc30d81d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:31.730172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:31.731028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:31.731836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:31.731836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:31.731836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:31.731836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:31.731836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 251/508] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:31.732154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.756792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.757463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.757749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.758028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.758849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:31.759118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.760498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.769088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 258/509] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:31.769704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.776257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:31.808207 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:31.832946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf4d4-f86f-49d1-934e-ba41373e522d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.868516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c482d-0c40-45c6-b0d1-b817c20bab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.869182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c482d-0c40-45c6-b0d1-b817c20bab31 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.869478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c482d-0c40-45c6-b0d1-b817c20bab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.869767 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c482d-0c40-45c6-b0d1-b817c20bab31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.873919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4160cba-57cd-4412-9043-7ef2793943d5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:31.906038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:31.907107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:31.907395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:31.907675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:31.915418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.916861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:31.932757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:31.933617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 259/510] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:31.935098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:31.936861 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c482d-0c40-45c6-b0d1-b817c20bab31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:31.938444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c482d-0c40-45c6-b0d1-b817c20bab31 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:31.994952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.012182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.032855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2262de-625b-4363-91d5-339b089ff937 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.036311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 252/511] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:32.037113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c482d-0c40-45c6-b0d1-b817c20bab31 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.070746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b8f88-1e9d-45ac-91db-1c7041d8910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.071433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8f88-1e9d-45ac-91db-1c7041d8910f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.071719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8f88-1e9d-45ac-91db-1c7041d8910f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.071996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8f88-1e9d-45ac-91db-1c7041d8910f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.135023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c482d-0c40-45c6-b0d1-b817c20bab31 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.138454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b8f88-1e9d-45ac-91db-1c7041d8910f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.140069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b8f88-1e9d-45ac-91db-1c7041d8910f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.172013 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.172684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.172974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.173257 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.173990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:32.174326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.175745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.186913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 253/512] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:32.187542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.206296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.222069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.245698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 260/513] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:32.246523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b8f88-1e9d-45ac-91db-1c7041d8910f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.286828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d99ab-c8b3-4db0-9eb0-922e60f9ee91 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.319256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.319990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.320281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.320565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.331467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.332961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.344302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b8f88-1e9d-45ac-91db-1c7041d8910f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:32.350203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:32.351031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:32.351833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:32.351833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:32.351833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:32.351833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:32.351833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 254/514] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:32.352197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.381362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.382035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.382321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.382607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.383464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:32.383776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.385222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.401933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 261/515] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:32.402692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.427402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.446950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.459537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524319-6fa4-4b35-8833-0e8a879ef60c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.493032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.493820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.494104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.494381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.501651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032bbd6-874f-41bd-894d-7a3979ee604a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.505036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.506470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:32.523666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:32.524692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:32.525717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:32.525717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:32.525717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:32.525717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:32.525717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 255/516] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:32.525717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.538400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2ceaf-ad32-41a9-91ce-676394cb06d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.539108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ceaf-ad32-41a9-91ce-676394cb06d9 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.539391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ceaf-ad32-41a9-91ce-676394cb06d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.539664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ceaf-ad32-41a9-91ce-676394cb06d9 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.540360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2ceaf-ad32-41a9-91ce-676394cb06d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.541792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2ceaf-ad32-41a9-91ce-676394cb06d9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.560755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 262/517] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:32 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:32.561908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2ceaf-ad32-41a9-91ce-676394cb06d9 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.640105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636fea-dafd-421a-9887-611d7e4f1ea1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.659012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.678602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.679460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.679753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.680038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.687367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2ceaf-ad32-41a9-91ce-676394cb06d9 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.690941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.693436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.695582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:32.714685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:32.715576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:32.716367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:32.716367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:32.716367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:32.716367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:32.716367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 256/518] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:32.716904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.729509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.730189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.731269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.731559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.732294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:32.732611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.733993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.747024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 263/519] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:32.748144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.829514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202594-ebf5-4a51-9149-dac928bf8993 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.853055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbd4a3-8b73-4594-83dd-241c2f67a6dd None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:32.865203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb019a0-068d-49d1-b4ae-19bc5abdeb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.865853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb019a0-068d-49d1-b4ae-19bc5abdeb0e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.866134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb019a0-068d-49d1-b4ae-19bc5abdeb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.866519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb019a0-068d-49d1-b4ae-19bc5abdeb0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.887642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:32.888314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.888602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.888880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.889605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:32.889912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.891413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:32.898437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.904653 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 264/520] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:32.905314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:32.933452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.944340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb019a0-068d-49d1-b4ae-19bc5abdeb0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:32.945846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb019a0-068d-49d1-b4ae-19bc5abdeb0e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.005871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cebfd7-3286-41cb-9888-107b6c2efb68 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.040382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.041073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.041365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.041651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.042377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:33.042694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.044139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.055501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 257/521] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:33.056661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb019a0-068d-49d1-b4ae-19bc5abdeb0e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.063773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 265/522] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:33.064661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.124742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.163178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.172000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f53c50-54bc-4e7f-a766-68ec44b71557 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.175155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb019a0-068d-49d1-b4ae-19bc5abdeb0e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.208796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.210087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.210690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.211154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.211430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.212244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.212537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.212821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.218714 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.220015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.220288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.222104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:33.235171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:33.235994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:33.242046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:33.242046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:33.242046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:33.242046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:33.242046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:33.242046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:33.242046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:33.242046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:33.242460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:33.243264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:20:33.244245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:33.244729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 266/523] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:33.244729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.244853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 258/524] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:33.244853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.351341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1d80c-123f-4dd3-b6b1-f437f5f7f57e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.351703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cc707-8cb9-48cc-bfef-8094cfba73fa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.369503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.387676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.388576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.388869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.389033 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.389140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.389807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.390093 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.390367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.396833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.398277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.401688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.403167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:33.412786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:33.413671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:33.414571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 259/525] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:33.415064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:33.425098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:33.425921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:33.426737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:33.426737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:33.426737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:33.426737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:33.426737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 267/526] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:33.427057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.434716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.525916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4bfa-878a-4c46-9c19-d9a8fd91f6ea None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.530494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238478c0-d68f-45d9-9749-dd5a87b85984 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.561636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.562406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.562759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.563082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.563873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:33.564190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.566150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.566610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.567474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.567906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.568331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.569333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:33.569805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.571430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.585294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 260/527] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:33.586104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.597798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 268/528] 10.222.0.72 () {56 vars in 1139 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:33.597798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.628667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.663600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.695131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39982f1e-2b83-413d-b27b-1b5bbe49700e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.717772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d928f45-5302-46a3-9ff0-d00b9d241964 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.731859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.732833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.733185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.733533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.734335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:33.734653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.736217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.752716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 261/529] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:33.752716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.758749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.759457 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.759753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.760032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.760758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:33.761066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.762447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.781533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 269/530] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:33.781533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.855733 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1457083-acf9-499f-93ea-221cbdbcadcb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.876631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.889335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.890646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8abf61-cc0e-4902-b41a-678c191526b9 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.895458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.896122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.896411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.896693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.897523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=7926b212faa44c228ff4ad9e63ee0287) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:33.897837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.899438 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.914809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 262/531] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/role_assignments?user.id=7926b212faa44c228ff4ad9e63ee0287&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:33.914809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.945816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564e4a3-19f4-423a-9836-a29b33bcf4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.946419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564e4a3-19f4-423a-9836-a29b33bcf4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.946707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564e4a3-19f4-423a-9836-a29b33bcf4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.947038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564e4a3-19f4-423a-9836-a29b33bcf4a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.015112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683695a0-7512-49c2-818a-d9cc627e3d33 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:34.038798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564e4a3-19f4-423a-9836-a29b33bcf4a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:34.040405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564e4a3-19f4-423a-9836-a29b33bcf4a0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:34.065775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:34.066818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.067108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.067391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.068895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=a81dce4c3ffd42bd85bf6e7687b5cbe0) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:34.069219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:34.071059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:34.078740 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 263/532] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/role_assignments?user.id=a81dce4c3ffd42bd85bf6e7687b5cbe0&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:34.079952 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:34.172485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:34.189677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 270/533] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:34.194991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:34.196601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564e4a3-19f4-423a-9836-a29b33bcf4a0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:34.313867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564e4a3-19f4-423a-9836-a29b33bcf4a0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:34.318921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1436440-74b9-4514-a744-e3e37b84d23d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:34.360594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:34.361702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.362016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.362293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.366739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:34.367812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.368317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.368796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.376130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:34.378389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:34.383316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:34.384789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:34.393954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:34.394806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:34.395641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:34.395641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:34.395641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:34.395641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:34.395641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:34.395641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:34.395641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:34.395641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:34.398067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 264/534] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:34.403203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:34.404005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:34.404851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:34.404851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:34.404851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:34.404851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:34.404851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 271/535] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:34.406083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:34.410083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:34.489519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:34.534960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf320-b427-423b-99bf-6ee1ad0e196c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:34.559187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:34.577076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:34.578353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.580586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.581089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.582089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:34.583628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:34.585307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:34.608342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923b8a-bedd-43f5-8ade-36504dfb04ee None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:34.614796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 265/536] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:34.614796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:34.667517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:34.668204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.668488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.668766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.669494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:34.669802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:34.671209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:34.693264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 272/537] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:34.699871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:34.803628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce009b-cb3a-41b1-840a-bebb91a4d8db None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:34.836883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:34.841707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3211e3-65b7-45b9-a30d-c3660363ca59 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:34.842592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70df2da-a217-43aa-9673-bc61ba7fe462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:34.843494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df2da-a217-43aa-9673-bc61ba7fe462 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.844523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df2da-a217-43aa-9673-bc61ba7fe462 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.844950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df2da-a217-43aa-9673-bc61ba7fe462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.847429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70df2da-a217-43aa-9673-bc61ba7fe462 None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=b5188e1b57154bcba6fa56978085741d) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:34.847903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70df2da-a217-43aa-9673-bc61ba7fe462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:34.849728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70df2da-a217-43aa-9673-bc61ba7fe462 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:34.859089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 266/538] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:34 2022] GET /identity/v3/role_assignments?user.id=b5188e1b57154bcba6fa56978085741d&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:34.860762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a8ba-8925-41cf-ab33-f9750acff9f3 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.861916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a8ba-8925-41cf-ab33-f9750acff9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.863246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a8ba-8925-41cf-ab33-f9750acff9f3 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.871272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 267/539] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:34.873867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b6094-a497-4797-aff9-1fa4873e925f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.874513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b6094-a497-4797-aff9-1fa4873e925f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.875104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b6094-a497-4797-aff9-1fa4873e925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.904741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-997b6094-a497-4797-aff9-1fa4873e925f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:34.905957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-997b6094-a497-4797-aff9-1fa4873e925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:34.924723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:34.925555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:34.925841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:34.926118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:34.943449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:34.944956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:34.973139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:34.974039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:34.974888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:34.974888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:34.974888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:34.974888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:34.974888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:34.974888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:34.974888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:34.974888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:34.979117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 273/540] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:34.980897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:35.011772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:35.062282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 268/541] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:35.088482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b6094-a497-4797-aff9-1fa4873e925f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:35.121768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9c1f-98ae-4e8b-9fae-d8d25193adc7 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:35.168928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:35.169606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:35.169891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:35.170169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:35.170993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:35.171309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:35.172785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:35.207489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 274/542] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:35.213796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:35.239263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:35.327211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b6094-a497-4797-aff9-1fa4873e925f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:35.374692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b935a-62de-497d-83ed-8ac10b01b3ae None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:35.395835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bef195-bc76-42c7-81a8-bc0d7b5cd674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:35.396643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bef195-bc76-42c7-81a8-bc0d7b5cd674 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:35.396925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bef195-bc76-42c7-81a8-bc0d7b5cd674 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:35.397200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bef195-bc76-42c7-81a8-bc0d7b5cd674 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:35.419689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bef195-bc76-42c7-81a8-bc0d7b5cd674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-74bef195-bc76-42c7-81a8-bc0d7b5cd674 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:35.431304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:35.432174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:35.432930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:35.437215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 269/543] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:35.442068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bef195-bc76-42c7-81a8-bc0d7b5cd674 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:35.452325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:35.453021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:35.453310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:35.453590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:35.454436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=18d55b1fd69640548e7b35258e33e7cd) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:35.455281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:35.456763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:35.467298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 275/544] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:35 2022] GET /identity/v3/role_assignments?user.id=18d55b1fd69640548e7b35258e33e7cd&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:35.494658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:35.582342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bef195-bc76-42c7-81a8-bc0d7b5cd674 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:35.624797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:35.625492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:35.625780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:35.626059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:35.627518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:35.627831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:35.629202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:35.638747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 270/545] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:35.644703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:35.769985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:35.789395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ef9a-2033-4f97-9ab2-0a8803647b1d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:35.825333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:35.826149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:35.826433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:35.826709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:35.844903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:35.846887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:35.866455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:35.868521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:35.870525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:35.870525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:35.870525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:35.870525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:35.870525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 276/546] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:35.874667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:35.987930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:35.994066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774eff-4156-44c9-9758-e0a61554635f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:36.029902 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f68584-a441-4649-8fa6-a48a85b8045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:36.030582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f68584-a441-4649-8fa6-a48a85b8045a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.030895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f68584-a441-4649-8fa6-a48a85b8045a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.031178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f68584-a441-4649-8fa6-a48a85b8045a None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.032217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f68584-a441-4649-8fa6-a48a85b8045a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:36.032527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f68584-a441-4649-8fa6-a48a85b8045a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:36.034451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f68584-a441-4649-8fa6-a48a85b8045a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:36.047954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 271/547] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:36.051882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:36.173080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad5e2-4897-4ee8-9657-909e3bf19bf1 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:36.223646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:36.224458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.224805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.225081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.227949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:36.234073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:36.235614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:36.244408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82836-6011-4afa-8451-b1df5728c0a9 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.244700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82836-6011-4afa-8451-b1df5728c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.244949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82836-6011-4afa-8451-b1df5728c0a9 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.246612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 272/548] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:36.254294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:36.256510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:20:36.259366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:36.260714 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 277/549] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:36.264361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbff14-ddea-479b-a523-29a73b6056be None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.264651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbff14-ddea-479b-a523-29a73b6056be None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.264934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbff14-ddea-479b-a523-29a73b6056be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.265826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:36.291818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-63bbff14-ddea-479b-a523-29a73b6056be None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:36.293003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-63bbff14-ddea-479b-a523-29a73b6056be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:36.363700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 273/550] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:36.396107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c62-e8e8-4cfb-9f32-f133e80963c9 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.396569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c62-e8e8-4cfb-9f32-f133e80963c9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.396948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c62-e8e8-4cfb-9f32-f133e80963c9 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.398630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 274/551] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:36.399430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7c62-e8e8-4cfb-9f32-f133e80963c9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:36.434272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1140e42-5cb6-45d2-8430-6a235e411e6b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:36.481047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2645ba2-f4a0-4544-a4e2-ffffa68e3375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:36.481735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645ba2-f4a0-4544-a4e2-ffffa68e3375 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.482469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645ba2-f4a0-4544-a4e2-ffffa68e3375 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.482762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645ba2-f4a0-4544-a4e2-ffffa68e3375 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.483912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645ba2-f4a0-4544-a4e2-ffffa68e3375 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:36.484230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645ba2-f4a0-4544-a4e2-ffffa68e3375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:36.486476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645ba2-f4a0-4544-a4e2-ffffa68e3375 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:36.489975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:36.507457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7c62-e8e8-4cfb-9f32-f133e80963c9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:36.516878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 278/552] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jul 12 14:20:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:36.519321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcd929-1e09-495e-8c34-34ea53071446 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.519620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcd929-1e09-495e-8c34-34ea53071446 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.519906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcd929-1e09-495e-8c34-34ea53071446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.542723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-8dfcd929-1e09-495e-8c34-34ea53071446 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:36.544161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8dfcd929-1e09-495e-8c34-34ea53071446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:36.545573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8c4ac-5488-4411-ad45-d63149dea451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:36.546472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c4ac-5488-4411-ad45-d63149dea451 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.546869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c4ac-5488-4411-ad45-d63149dea451 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.547252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c4ac-5488-4411-ad45-d63149dea451 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.558199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8c4ac-5488-4411-ad45-d63149dea451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-45f8c4ac-5488-4411-ad45-d63149dea451 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:36.566701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:36.567909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:36.568993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:36.569630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 275/553] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:36.574798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8c4ac-5488-4411-ad45-d63149dea451 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:36.613022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:36.636468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 279/554] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:36.637932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcd929-1e09-495e-8c34-34ea53071446 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:36.710161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8c4ac-5488-4411-ad45-d63149dea451 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:36.746384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7527a-f6c0-4a45-a01a-6e41b8b5ec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:36.747219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7527a-f6c0-4a45-a01a-6e41b8b5ec40 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.747607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7527a-f6c0-4a45-a01a-6e41b8b5ec40 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.747982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7527a-f6c0-4a45-a01a-6e41b8b5ec40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.765342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:36.775296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcd929-1e09-495e-8c34-34ea53071446 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:36.811927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:36.812610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.812898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.813178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.813995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:36.814834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:36.816302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:36.823790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7527a-f6c0-4a45-a01a-6e41b8b5ec40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:36.825286 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7527a-f6c0-4a45-a01a-6e41b8b5ec40 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:36.830314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 280/555] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:36.831271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:36.880873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:36.931337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 276/556] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:36.932291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7527a-f6c0-4a45-a01a-6e41b8b5ec40 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:36.943218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb37488-31fb-407b-9542-6a5e49d3c711 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:36.980411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b849e-316b-4a8c-88bf-bf0d88068684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:36.981258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b849e-316b-4a8c-88bf-bf0d88068684 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.981579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b849e-316b-4a8c-88bf-bf0d88068684 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.981875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:36.982478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b849e-316b-4a8c-88bf-bf0d88068684 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.996147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b849e-316b-4a8c-88bf-bf0d88068684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f99b849e-316b-4a8c-88bf-bf0d88068684 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:37.004629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.005511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:37.006305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:37.010715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 281/557] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.011615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b849e-316b-4a8c-88bf-bf0d88068684 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.039153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7527a-f6c0-4a45-a01a-6e41b8b5ec40 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.076079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.077044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.077429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.077812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.089211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.091163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:37.109581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.111649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.112523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:37.112523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:37.112523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:37.112523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:37.112523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 277/558] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.112786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.143999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b849e-316b-4a8c-88bf-bf0d88068684 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.171959 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.181049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.182034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.182338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.182971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.197822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.199760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:37.221039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.221973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.222974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:37.222974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:37.222974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:37.222974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:37.222974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 282/559] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.223263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.225245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.229767 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da6b68-c347-4fa4-83a9-7d88028be5d1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.266790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e025-5bff-4098-8dae-62a324598b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.267742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e025-5bff-4098-8dae-62a324598b3c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.268171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e025-5bff-4098-8dae-62a324598b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.268691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e025-5bff-4098-8dae-62a324598b3c None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.269693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e025-5bff-4098-8dae-62a324598b3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:37.270145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e025-5bff-4098-8dae-62a324598b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.271794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e025-5bff-4098-8dae-62a324598b3c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.280313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 278/560] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.282079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42e131-2b49-4b42-a49f-acf36d13d8ac None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.282368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42e131-2b49-4b42-a49f-acf36d13d8ac None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.283177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42e131-2b49-4b42-a49f-acf36d13d8ac None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.284549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 279/561] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:37.285073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42e131-2b49-4b42-a49f-acf36d13d8ac None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.331182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a8d1f-4a3c-4755-8265-41575ce1c0ce None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.366807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.367708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.368537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.369000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.369886 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:37.370666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.372534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.384697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 283/562] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.385495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.399787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42e131-2b49-4b42-a49f-acf36d13d8ac None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.408419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.437324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62801e40-8860-4208-bc79-026c0a6c1121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.438125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801e40-8860-4208-bc79-026c0a6c1121 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.438419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801e40-8860-4208-bc79-026c0a6c1121 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.438701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801e40-8860-4208-bc79-026c0a6c1121 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.439497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62801e40-8860-4208-bc79-026c0a6c1121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:37.439808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62801e40-8860-4208-bc79-026c0a6c1121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.441166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62801e40-8860-4208-bc79-026c0a6c1121 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.452929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 280/563] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.454131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692373-4c3a-4592-bdea-10f67311a50a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.454943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692373-4c3a-4592-bdea-10f67311a50a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.455242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692373-4c3a-4592-bdea-10f67311a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.471860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f8692373-4c3a-4592-bdea-10f67311a50a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:37.473036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f8692373-4c3a-4592-bdea-10f67311a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:37.488362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.501728 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112281d-8fd8-4bb1-b19e-ac8e49efba62 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.537571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.538311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.538599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.538907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.558794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 281/564] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:37.558966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.559079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8692373-4c3a-4592-bdea-10f67311a50a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.559164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:37.576006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.577114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.578201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:37.578201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:37.578201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:37.578201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:37.580234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 284/565] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.581356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.654189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.667621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8692373-4c3a-4592-bdea-10f67311a50a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.688054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30065b-675d-42b5-a07b-82a86791fb35 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.709238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.710612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.711438 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.712334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.722390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.723114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.723921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.724208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.724488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.724948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.731409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.732867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:37.741578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.742658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:37.743795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:37.750217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.751771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 285/566] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.752821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.753776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 282/567] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.754730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.771116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.854050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9f564-55c7-4260-997f-fa6cb732ebd4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.866477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9331d-0fa1-4b0f-a04d-3e77a1d912e2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.886215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.893779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add12f7b-afee-423b-96a8-dbdde13132b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.894589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12f7b-afee-423b-96a8-dbdde13132b8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.894909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12f7b-afee-423b-96a8-dbdde13132b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.895186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12f7b-afee-423b-96a8-dbdde13132b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.903522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.904189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.904474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.904767 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.905464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:37.905574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add12f7b-afee-423b-96a8-dbdde13132b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:37.905769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.907419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-add12f7b-afee-423b-96a8-dbdde13132b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:37.913537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.914435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 286/568] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.916218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add12f7b-afee-423b-96a8-dbdde13132b8 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.929194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 283/569] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.929194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.995077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.020529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add12f7b-afee-423b-96a8-dbdde13132b8 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.028303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21e25f-21c6-4a81-adf5-a14981437c93 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.053215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.053892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.054178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.054453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.055315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:38.055625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.057071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.063421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.064594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.064883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.065166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.065958 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:38.066275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.067737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.076519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 287/570] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.077479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.084843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 284/571] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.085653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.124945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.175296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb17d4d-4fc6-4710-a2c3-a388784358d0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.186396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e17e-0adf-45a5-b745-e53bdf70708f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.208361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2390d5a-8e81-4095-ba7b-452734cb1e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.209039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390d5a-8e81-4095-ba7b-452734cb1e9f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.209325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390d5a-8e81-4095-ba7b-452734cb1e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.209602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390d5a-8e81-4095-ba7b-452734cb1e9f None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.210343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390d5a-8e81-4095-ba7b-452734cb1e9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:38.210656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390d5a-8e81-4095-ba7b-452734cb1e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.212085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390d5a-8e81-4095-ba7b-452734cb1e9f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.214964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.219987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 288/572] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.221237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8a76-a03f-4671-9a40-cf249c7b0837 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.221343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.221534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8a76-a03f-4671-9a40-cf249c7b0837 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.221815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8a76-a03f-4671-9a40-cf249c7b0837 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.222129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.222440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.222728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.223236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 289/573] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:38.223782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea8a76-a03f-4671-9a40-cf249c7b0837 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.234034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.235514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:38.250249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:38.251974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:38.252892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 285/574] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:38.253471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.327218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea8a76-a03f-4671-9a40-cf249c7b0837 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.337459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.350792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef817654-8f45-4e62-97dc-343d05d40ffe None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.361430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.362234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.362525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.362829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.372732 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.374187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.385271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb97cc-085c-4d17-b65e-1040c29598b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.385862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb97cc-085c-4d17-b65e-1040c29598b1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.386151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb97cc-085c-4d17-b65e-1040c29598b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.386429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb97cc-085c-4d17-b65e-1040c29598b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.387295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb97cc-085c-4d17-b65e-1040c29598b1 None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=9422f3bea364469093eb4046b011017e) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:38.387611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb97cc-085c-4d17-b65e-1040c29598b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.389032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb97cc-085c-4d17-b65e-1040c29598b1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:38.391846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:38.392799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:38.393646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:38.393646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:38.393646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:38.393646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:38.393646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 290/575] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:38.394286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.394718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 286/576] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/role_assignments?user.id=9422f3bea364469093eb4046b011017e&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.395943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7065f5-85eb-4f4d-b9ce-1aaac6ad6c70 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.396241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7065f5-85eb-4f4d-b9ce-1aaac6ad6c70 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.396525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7065f5-85eb-4f4d-b9ce-1aaac6ad6c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.414094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9c7065f5-85eb-4f4d-b9ce-1aaac6ad6c70 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:38.415462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9c7065f5-85eb-4f4d-b9ce-1aaac6ad6c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:38.473823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.509153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be063e-979b-46b8-850d-9e6ac24a897f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.511204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 287/577] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:38.513447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7065f5-85eb-4f4d-b9ce-1aaac6ad6c70 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.554459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.555805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.556140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.556370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.568213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.569691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:38.588239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:38.589138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:38.589997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:38.589997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:38.589997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:38.589997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:38.589997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 291/578] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:38.590693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.608782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.631633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7065f5-85eb-4f4d-b9ce-1aaac6ad6c70 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.666699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.667489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.667844 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.668130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.668973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:38.669282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.670698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.700618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ff1a-5085-45d6-b1ee-c5efc343c93c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.709104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 288/579] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.709774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.741697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.742365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.742651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.742951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.743674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:38.743983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.745355 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.755401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.758401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 292/580] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.759291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.831498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1884f0-1c7d-42af-bbfd-bcd706fc21c4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.839569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.870927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc39d-c97e-4c35-9820-d9afb012ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.871727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc39d-c97e-4c35-9820-d9afb012ca55 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.872017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc39d-c97e-4c35-9820-d9afb012ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.872296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc39d-c97e-4c35-9820-d9afb012ca55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.875126 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399533ca-6158-44f6-8c31-0769c97b87cc None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.883814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccc39d-c97e-4c35-9820-d9afb012ca55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-cdccc39d-c97e-4c35-9820-d9afb012ca55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:38.891208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:38.892153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:38.893056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:38.897383 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 289/581] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:38.898255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc39d-c97e-4c35-9820-d9afb012ca55 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.913627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.914374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.914587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.914894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.915674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:38.915921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.917387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.929348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 293/582] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.934404 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.004897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc39d-c97e-4c35-9820-d9afb012ca55 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.006409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.042414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ad0f-a5be-435c-b24d-93f6cde2fe03 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.042714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.043476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.043766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.044059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.057306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.061575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.080115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad744258-8605-486f-9e67-917abeda194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:39.080307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:39.081165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:39.082036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:39.082036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:39.082036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:39.082036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:39.082263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad744258-8605-486f-9e67-917abeda194c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.082263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad744258-8605-486f-9e67-917abeda194c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.082263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad744258-8605-486f-9e67-917abeda194c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.082446 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 290/583] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:39.082678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.088140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.093873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad744258-8605-486f-9e67-917abeda194c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.095931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad744258-8605-486f-9e67-917abeda194c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-ad744258-8605-486f-9e67-917abeda194c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:39.110359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:39.111757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:39.112616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 294/584] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:39.113084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad744258-8605-486f-9e67-917abeda194c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.195241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c020d8e-1443-445c-87ba-f81eb30734ba None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.223710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad744258-8605-486f-9e67-917abeda194c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.231855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.232525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.232814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.233104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.233846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:39.234155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.236135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.249344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 291/585] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.250178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.259615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.260423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.261057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.261342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.267729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.269367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.270911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:39.287052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:39.287946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:39.288854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 295/586] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:39.289433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.350113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.361231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5f2f-d711-4bfb-822b-8b2c3ecf5f1d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.396260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82999462-3b4d-4dcd-a393-6471aa2ee679 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.402609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.403312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.403601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.403883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.404615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:39.404924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.406863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.419539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 292/587] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.420362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.437169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.437847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.438191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.438509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.439313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:39.439629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.441079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.453573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 296/588] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.454349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.513690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.537596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1040e-9d08-4f75-ae2d-4ed82a810090 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.562476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b51e05-751f-4bab-8149-6f5d139839a1 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.573707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.574502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.574803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.575095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.576724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.586178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.587668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.598793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.599477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.599769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.600051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.600884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:39.601199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.602623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:39.605337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:39.606294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:39.607222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:39.607222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:39.607222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:39.607222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:39.607222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 293/589] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:39.607499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.623190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 297/590] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.624247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.723215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcd3ac-14b4-4900-bfdf-c695534ebb6e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.726232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27472a-3c04-44cc-a4d1-b2fea8523155 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.749144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.757479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.758281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.758571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.758882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.764588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a273a3a-dc77-4837-ac53-36bd6ccda74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.765494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273a3a-dc77-4837-ac53-36bd6ccda74d None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.765597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.765781 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273a3a-dc77-4837-ac53-36bd6ccda74d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.766059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273a3a-dc77-4837-ac53-36bd6ccda74d None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/7926b212faa44c228ff4ad9e63ee0287/roles/b7366b7493b54614bff185596a63f32f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.767497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.781710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a273a3a-dc77-4837-ac53-36bd6ccda74d None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=7926b212faa44c228ff4ad9e63ee0287, role_id=b7366b7493b54614bff185596a63f32f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:39.781848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:39.783322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:39.784175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 294/591] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:39.784645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.785499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a273a3a-dc77-4837-ac53-36bd6ccda74d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.806802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 298/592] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:39 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/7926b212faa44c228ff4ad9e63ee0287/roles/b7366b7493b54614bff185596a63f32f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:39.806802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a273a3a-dc77-4837-ac53-36bd6ccda74d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.840202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.920963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6387-0386-4c0c-a371-8f4fd237ef62 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.951928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a273a3a-dc77-4837-ac53-36bd6ccda74d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.962069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.962757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.963079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.963358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.964096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:39.964409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.965798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.978852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 295/593] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.979423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.990343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.991185 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.991475 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.991757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.003074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.004791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:40.029690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:40.030610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:40.031783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:40.031783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:40.031783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:40.031783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:40.031783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 299/594] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:40.032546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.049023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.112769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65380ae-e4db-4045-bea1-db24df9f95d2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.140152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.150000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.151226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.151818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.152258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.153211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:40.153759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.155591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.172581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa821d-97d7-46fa-be53-4f4138b66bc8 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.178303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 296/595] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:40.180070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.220410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.221827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.223114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.223225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.234497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.236512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:40.251164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:40.252114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:20:40.253018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:40.257014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 300/596] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:40.257820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.298491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca478a-56d0-43b5-b32b-28fdc6cb5356 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.309035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.344407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.346002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.346509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.347026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.347975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:40.348599 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.350202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.363588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 297/597] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:40.364687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.384682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351442d3-0bce-4b7c-b5eb-29423dee3778 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.430258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfd7b6-8737-488b-8298-d69025f51c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.431758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd7b6-8737-488b-8298-d69025f51c90 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.432052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd7b6-8737-488b-8298-d69025f51c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.432479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd7b6-8737-488b-8298-d69025f51c90 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/a81dce4c3ffd42bd85bf6e7687b5cbe0/roles/b7366b7493b54614bff185596a63f32f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.434978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.447860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfd7b6-8737-488b-8298-d69025f51c90 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=a81dce4c3ffd42bd85bf6e7687b5cbe0, role_id=b7366b7493b54614bff185596a63f32f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.449317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfd7b6-8737-488b-8298-d69025f51c90 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.463070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 301/598] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:40 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/a81dce4c3ffd42bd85bf6e7687b5cbe0/roles/b7366b7493b54614bff185596a63f32f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:40.471820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfd7b6-8737-488b-8298-d69025f51c90 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.477795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77de6b-4767-451c-82d0-c8918f9bd55c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.520395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec59a72-a8d2-4013-bf47-2ee6c71583a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.521014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59a72-a8d2-4013-bf47-2ee6c71583a5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.521307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59a72-a8d2-4013-bf47-2ee6c71583a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.521593 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59a72-a8d2-4013-bf47-2ee6c71583a5 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.522478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec59a72-a8d2-4013-bf47-2ee6c71583a5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:40.522834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec59a72-a8d2-4013-bf47-2ee6c71583a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.524381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec59a72-a8d2-4013-bf47-2ee6c71583a5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.551910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 298/599] 10.222.0.72 () {56 vars in 1139 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:40.553553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd11b-ab5e-4161-a951-60dd73aa1563 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.553906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd11b-ab5e-4161-a951-60dd73aa1563 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.554195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd11b-ab5e-4161-a951-60dd73aa1563 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.560204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 299/600] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:40.560204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd11b-ab5e-4161-a951-60dd73aa1563 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.593036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.627585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfd7b6-8737-488b-8298-d69025f51c90 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.670439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de7709-59eb-4268-99ec-f44296f88d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.671294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7709-59eb-4268-99ec-f44296f88d1e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.671585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7709-59eb-4268-99ec-f44296f88d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.671869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7709-59eb-4268-99ec-f44296f88d1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.678814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de7709-59eb-4268-99ec-f44296f88d1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.680236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de7709-59eb-4268-99ec-f44296f88d1e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.688451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd11b-ab5e-4161-a951-60dd73aa1563 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f7de7709-59eb-4268-99ec-f44296f88d1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:40.694861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:40.695726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:40.696642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 302/601] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:40.702807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c1bf-4299-4b0a-8a14-ae0f9a6e0143 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.702807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c1bf-4299-4b0a-8a14-ae0f9a6e0143 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.702807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c1bf-4299-4b0a-8a14-ae0f9a6e0143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.715424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b8b6c1bf-4299-4b0a-8a14-ae0f9a6e0143 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:40.716626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b8b6c1bf-4299-4b0a-8a14-ae0f9a6e0143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:40.730495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.731998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.732297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.732574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.745618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.747775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.764103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:40.773184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:40.774910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:40.775828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:40.775828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:40.775828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:40.775828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:40.775828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 300/602] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:40.775828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.798736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 303/603] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:40.799797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c1bf-4299-4b0a-8a14-ae0f9a6e0143 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.873890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.898898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c893-271b-48b4-bb94-8f35f438bf05 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.932298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c1bf-4299-4b0a-8a14-ae0f9a6e0143 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.952510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.953185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.953472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.953751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.955141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:40.955453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.956891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.974824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 301/604] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:40.974824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.993825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.995582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.995875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.996156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.996891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:40.997205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.998600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:41.018954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 304/605] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:41.020321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.056792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:41.094798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927cc1e-8347-4d4c-bf40-acb3ca56b7a0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:41.130076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41a99e-aae1-430a-b16e-7bda17f4178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:41.130917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41a99e-aae1-430a-b16e-7bda17f4178d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.131208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41a99e-aae1-430a-b16e-7bda17f4178d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.131486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41a99e-aae1-430a-b16e-7bda17f4178d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.131688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6868f7-2666-4ed5-a84f-8417538bff03 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:41.142094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41a99e-aae1-430a-b16e-7bda17f4178d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-7a41a99e-aae1-430a-b16e-7bda17f4178d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:41.149950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:41.150873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 302/606] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:41.152341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41a99e-aae1-430a-b16e-7bda17f4178d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.153768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:41.172076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678ed2-1e4c-404e-8603-171b151cdff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:41.173874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678ed2-1e4c-404e-8603-171b151cdff3 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678ed2-1e4c-404e-8603-171b151cdff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.174670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d678ed2-1e4c-404e-8603-171b151cdff3 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/b5188e1b57154bcba6fa56978085741d/roles/b7366b7493b54614bff185596a63f32f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.190799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d678ed2-1e4c-404e-8603-171b151cdff3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=b5188e1b57154bcba6fa56978085741d, role_id=b7366b7493b54614bff185596a63f32f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:41.192391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d678ed2-1e4c-404e-8603-171b151cdff3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:41.214870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 305/607] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:41 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/b5188e1b57154bcba6fa56978085741d/roles/b7366b7493b54614bff185596a63f32f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:41.215852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678ed2-1e4c-404e-8603-171b151cdff3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.322695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41a99e-aae1-430a-b16e-7bda17f4178d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:41.392124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:41.393803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.394092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.394378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.399155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:41.408244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:41.409739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:41.426935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d678ed2-1e4c-404e-8603-171b151cdff3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:41.431945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:41.432820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:41.433774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 303/608] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:41.445278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.486864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:41.486864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.486864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.486864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.487290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:41.487290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:41.487421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:41.497664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 306/609] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:41.503608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.569238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:41.625562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e38727-9bfa-4fd3-9103-54f9cb17a76a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:41.664923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d2507-b048-4ec7-9ade-1156e0154b07 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:41.666736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:41.667748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.668169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.668581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.682332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:41.684193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:41.692839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:41.709041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:41.709993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:41.710919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:41.710919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:41.710919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:41.710919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:41.713230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 307/610] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:41.719930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.775497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:41.776183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.776473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.776747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.777541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:41.777851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:41.779316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:41.809487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 304/611] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:41.815749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.836779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ca6b-aecc-4f02-8266-b4756fbe9eae None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:41.896363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:41.897055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.897343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.897626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.898362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:41.898677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:41.900099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:41.926932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 308/612] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:41.935813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.999682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377fd37-51fe-4684-a657-5164e7aad887 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.017109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.027164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.039910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162204d-b0df-4d83-a025-f1e554e9a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.040723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162204d-b0df-4d83-a025-f1e554e9a7c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.041007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162204d-b0df-4d83-a025-f1e554e9a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.041281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162204d-b0df-4d83-a025-f1e554e9a7c6 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/18d55b1fd69640548e7b35258e33e7cd/roles/b7366b7493b54614bff185596a63f32f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.063995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162204d-b0df-4d83-a025-f1e554e9a7c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=18d55b1fd69640548e7b35258e33e7cd, role_id=b7366b7493b54614bff185596a63f32f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.065695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162204d-b0df-4d83-a025-f1e554e9a7c6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.072888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c6b61-6617-4015-8fe2-d5a0e347d0aa None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.087374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 305/613] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:41 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/18d55b1fd69640548e7b35258e33e7cd/roles/b7366b7493b54614bff185596a63f32f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:42.089394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ada357-1524-4fa5-87d4-e54989698170 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.089693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ada357-1524-4fa5-87d4-e54989698170 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.089973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ada357-1524-4fa5-87d4-e54989698170 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.097410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 306/614] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:42.098680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107e47-cfc7-4799-9823-6f022fee3846 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.099001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107e47-cfc7-4799-9823-6f022fee3846 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.099280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107e47-cfc7-4799-9823-6f022fee3846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.136667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1d107e47-cfc7-4799-9823-6f022fee3846 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:42.137883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1d107e47-cfc7-4799-9823-6f022fee3846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:42.146244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.147154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.147384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.147656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.163658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.165156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:42.195468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:42.196468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:42.197893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 309/615] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:42.207720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.313303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 307/616] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:42.339007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d107e47-cfc7-4799-9823-6f022fee3846 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.354988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02e011-2a5c-406d-99ec-9ee40cd7c60e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.378897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.400963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.401747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.402137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.402522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.403511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:42.403931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.406584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.434860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 310/617] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:42.437188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.457098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.461578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d107e47-cfc7-4799-9823-6f022fee3846 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.541992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324d94-e80f-4f5b-a9cb-c301b483cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.542949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324d94-e80f-4f5b-a9cb-c301b483cd00 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.543239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324d94-e80f-4f5b-a9cb-c301b483cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.543524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324d94-e80f-4f5b-a9cb-c301b483cd00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.570915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b4ab-3054-4c8c-b8a1-fca0b8e11c39 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.571990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c324d94-e80f-4f5b-a9cb-c301b483cd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-8c324d94-e80f-4f5b-a9cb-c301b483cd00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:42.588480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:42.589650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:42.590964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 308/618] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:42.597751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324d94-e80f-4f5b-a9cb-c301b483cd00 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.627075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd6e3f-fc02-416b-a488-0216e518f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.628814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd6e3f-fc02-416b-a488-0216e518f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.629521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd6e3f-fc02-416b-a488-0216e518f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.630269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd6e3f-fc02-416b-a488-0216e518f2e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.652945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd6e3f-fc02-416b-a488-0216e518f2e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.656369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd6e3f-fc02-416b-a488-0216e518f2e7 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-5dcd6e3f-fc02-416b-a488-0216e518f2e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:42.690585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:42.691627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:42.692682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:42.692682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:42.692682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:42.692682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:42.699022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 311/619] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:42.701333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593a582-40ff-4f7c-822f-725448be2597 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.701996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593a582-40ff-4f7c-822f-725448be2597 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.702416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593a582-40ff-4f7c-822f-725448be2597 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.704866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 312/620] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:42.705924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593a582-40ff-4f7c-822f-725448be2597 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.751168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.757118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324d94-e80f-4f5b-a9cb-c301b483cd00 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.800910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7b1b-9152-4b5e-ac5a-29daccf8941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.801961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7b1b-9152-4b5e-ac5a-29daccf8941d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.802323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7b1b-9152-4b5e-ac5a-29daccf8941d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.802677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7b1b-9152-4b5e-ac5a-29daccf8941d None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.804436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7b1b-9152-4b5e-ac5a-29daccf8941d None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:42.804969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7b1b-9152-4b5e-ac5a-29daccf8941d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.806807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7b1b-9152-4b5e-ac5a-29daccf8941d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.820508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 309/621] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:42.822034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1ce8-f6af-455a-a425-46a2bf5d9e4c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.822506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1ce8-f6af-455a-a425-46a2bf5d9e4c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.822994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d1ce8-f6af-455a-a425-46a2bf5d9e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.833655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593a582-40ff-4f7c-822f-725448be2597 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.848222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-653d1ce8-f6af-455a-a425-46a2bf5d9e4c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:42.850592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-653d1ce8-f6af-455a-a425-46a2bf5d9e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:42.870509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.871677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.872594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.873028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.873466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.874438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:42.874977 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.876773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.894055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 313/622] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:42.895140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.946878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 310/623] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:42.946878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d1ce8-f6af-455a-a425-46a2bf5d9e4c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.027331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.046596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a00b7-1cfe-4f3e-a65b-1b853f57c5ce None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.081742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d1ce8-f6af-455a-a425-46a2bf5d9e4c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.092285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.093624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.094023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.094443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.109165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.111769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.118924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.120228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.120657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.121086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.128975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.130620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:43.134170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:43.135266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:43.136354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:43.136354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:43.136354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:43.136354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:43.142858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 314/624] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:43.144099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:43.154405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:43.155797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:43.156947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:43.156947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:43.156947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:43.156947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:43.156947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:43.156947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:43.156947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:43.156947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:43.162801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 311/625] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:43.162801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.176537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.274299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0855a-5d7f-4119-bab5-d9c562131435 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.285602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ac1c-31d3-4fa1-be11-dcbf046c6bc7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.321811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.322681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96610c-4077-4b1d-82e1-ca4cc2b4a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.322927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.323385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.323795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96610c-4077-4b1d-82e1-ca4cc2b4a048 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.323948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.324257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96610c-4077-4b1d-82e1-ca4cc2b4a048 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.324632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96610c-4077-4b1d-82e1-ca4cc2b4a048 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.325137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:43.325591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.327144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.334360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.338695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96610c-4077-4b1d-82e1-ca4cc2b4a048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:43.341650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 312/626] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.342752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-0f96610c-4077-4b1d-82e1-ca4cc2b4a048 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:43.358348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:43.359530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:43.360609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:43.366859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 315/627] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:43.368680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96610c-4077-4b1d-82e1-ca4cc2b4a048 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.451197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.484202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96610c-4077-4b1d-82e1-ca4cc2b4a048 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.493409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce689c-6883-41d6-a9b5-70fa0aae3ccf None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.521190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.522270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.522487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.522654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.531408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.533383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.540484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.541447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.541944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.542431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.543476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:43.543999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.545644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:43.548269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:43.549158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:43.550115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:43.554089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 316/628] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:43.554991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.564780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 313/629] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.566051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.629417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.672810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a0fda-9571-4891-a223-430ed60c9549 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.675326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21199c-a205-46de-a2d5-e12401c819b1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.704069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.710385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.711178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.711289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143169-4bb0-40a0-a136-15d4d2239551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.711611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.711958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.712125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143169-4bb0-40a0-a136-15d4d2239551 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.712486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143169-4bb0-40a0-a136-15d4d2239551 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.712840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143169-4bb0-40a0-a136-15d4d2239551 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.712929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:43.713303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.713916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143169-4bb0-40a0-a136-15d4d2239551 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:43.714310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143169-4bb0-40a0-a136-15d4d2239551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.714919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.715867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143169-4bb0-40a0-a136-15d4d2239551 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.728013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 317/630] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.728013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.744366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 314/631] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.745900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f4d9-7583-475e-9abb-f9f3b80528c8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.746198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f4d9-7583-475e-9abb-f9f3b80528c8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.746484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f4d9-7583-475e-9abb-f9f3b80528c8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.747912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 315/632] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:43.748465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82f4d9-7583-475e-9abb-f9f3b80528c8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.840087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea089c-2d8b-4ed4-9b3b-c151a3ad87f4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.864141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.866273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82f4d9-7583-475e-9abb-f9f3b80528c8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.878651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fa179-c767-4544-bdcc-c4ea4e8d15a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.879544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fa179-c767-4544-bdcc-c4ea4e8d15a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.879822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fa179-c767-4544-bdcc-c4ea4e8d15a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.880106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fa179-c767-4544-bdcc-c4ea4e8d15a0 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/9422f3bea364469093eb4046b011017e/roles/b7366b7493b54614bff185596a63f32f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.896960 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fa179-c767-4544-bdcc-c4ea4e8d15a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=9422f3bea364469093eb4046b011017e, role_id=b7366b7493b54614bff185596a63f32f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.898413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fa179-c767-4544-bdcc-c4ea4e8d15a0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.902463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd5826-5e89-4715-ab3e-ec25eca4cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.903623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5826-5e89-4715-ab3e-ec25eca4cace None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.903932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5826-5e89-4715-ab3e-ec25eca4cace None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.904209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd5826-5e89-4715-ab3e-ec25eca4cace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.915488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 318/633] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:43 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/9422f3bea364469093eb4046b011017e/roles/b7366b7493b54614bff185596a63f32f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:43.915880 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd5826-5e89-4715-ab3e-ec25eca4cace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.916303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fa179-c767-4544-bdcc-c4ea4e8d15a0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.917969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd5826-5e89-4715-ab3e-ec25eca4cace None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4ffd5826-5e89-4715-ab3e-ec25eca4cace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:43.946987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:43.947980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:43.948833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:43.948833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:43.948833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:43.948833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:43.953129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 316/634] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:43.955470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5b40f-8794-40b1-830b-8ddb4a0161bb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.955739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5b40f-8794-40b1-830b-8ddb4a0161bb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.956024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5b40f-8794-40b1-830b-8ddb4a0161bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.974707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-65d5b40f-8794-40b1-830b-8ddb4a0161bb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:43.976002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-65d5b40f-8794-40b1-830b-8ddb4a0161bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:44.026713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.055204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fa179-c767-4544-bdcc-c4ea4e8d15a0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.077465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 317/635] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:44.079216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5b40f-8794-40b1-830b-8ddb4a0161bb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.115507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16282553-d515-4fa3-b3bd-bddc45a4fae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.116441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282553-d515-4fa3-b3bd-bddc45a4fae9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.116784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282553-d515-4fa3-b3bd-bddc45a4fae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.117069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282553-d515-4fa3-b3bd-bddc45a4fae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.174498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.214686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5b40f-8794-40b1-830b-8ddb4a0161bb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.218468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16282553-d515-4fa3-b3bd-bddc45a4fae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.220017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16282553-d515-4fa3-b3bd-bddc45a4fae9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.253631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.254683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.255214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.255712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.256631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:44.257151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.258821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.271626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 318/636] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.272728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.312363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.360788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 319/637] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:44.362000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16282553-d515-4fa3-b3bd-bddc45a4fae9 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.393268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39608ff-fd1b-4262-826c-19e4957e711f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.429563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6613ad-22e6-41c4-95c3-b7918bd08652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.430371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6613ad-22e6-41c4-95c3-b7918bd08652 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.430658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6613ad-22e6-41c4-95c3-b7918bd08652 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.430978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6613ad-22e6-41c4-95c3-b7918bd08652 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.437367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.443567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6613ad-22e6-41c4-95c3-b7918bd08652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-cd6613ad-22e6-41c4-95c3-b7918bd08652 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:44.451342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:44.452317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:44.453181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 319/638] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:44.453942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95192fa-96c0-472e-880e-f1ef0ee87719 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.454626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95192fa-96c0-472e-880e-f1ef0ee87719 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.454626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95192fa-96c0-472e-880e-f1ef0ee87719 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.455728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 320/639] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:44.456252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95192fa-96c0-472e-880e-f1ef0ee87719 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.477813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16282553-d515-4fa3-b3bd-bddc45a4fae9 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.516295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd044e2-8352-4627-8f7b-5a47a1adf53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.517986 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd044e2-8352-4627-8f7b-5a47a1adf53f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.518304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd044e2-8352-4627-8f7b-5a47a1adf53f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.518586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd044e2-8352-4627-8f7b-5a47a1adf53f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.526059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd044e2-8352-4627-8f7b-5a47a1adf53f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.527530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd044e2-8352-4627-8f7b-5a47a1adf53f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-3fd044e2-8352-4627-8f7b-5a47a1adf53f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:44.542413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:44.543554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:44.544502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 320/640] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:44.545105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef02bf-b7fe-4bcd-8a27-624a2634a910 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.545105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef02bf-b7fe-4bcd-8a27-624a2634a910 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.545993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef02bf-b7fe-4bcd-8a27-624a2634a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.560394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.567413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d3ef02bf-b7fe-4bcd-8a27-624a2634a910 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:44.568615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d3ef02bf-b7fe-4bcd-8a27-624a2634a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:44.572189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95192fa-96c0-472e-880e-f1ef0ee87719 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.607953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.608759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.609054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.609327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.620498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.621945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:44.639480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:44.640451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:44.641376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:44.641376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:44.641376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:44.641376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:44.641617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 321/641] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:44.641689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef02bf-b7fe-4bcd-8a27-624a2634a910 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.650235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 321/642] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:44.651909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.705254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.745836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef02bf-b7fe-4bcd-8a27-624a2634a910 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.770710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86429773-d43c-4d2c-9181-1b4d7750f10a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.781331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.782520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.782919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.783242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.784051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:44.784368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.785743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.798406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 322/643] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.798406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.812087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.812793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.813081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.813363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.814209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:44.814521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.815978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.831721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.836400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 322/644] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.837219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.904667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff80b-d156-4837-a4c6-cbd416bee73b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.928745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.942208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.943046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.943162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d38504-b291-4647-a125-d2d6edd753d4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.943459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.943842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.944641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:44.945039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.946550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.963392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 323/645] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.963392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.985291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80824a-939a-46aa-a5b6-6962f4cfbb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.986178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80824a-939a-46aa-a5b6-6962f4cfbb79 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.986533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80824a-939a-46aa-a5b6-6962f4cfbb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.986910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80824a-939a-46aa-a5b6-6962f4cfbb79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.997049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80824a-939a-46aa-a5b6-6962f4cfbb79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-de80824a-939a-46aa-a5b6-6962f4cfbb79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:45.005451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:45.006540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:45.007702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 323/646] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:45.008417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80824a-939a-46aa-a5b6-6962f4cfbb79 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.073014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.082918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266b34-3906-4797-bda7-958e7abfcbdc None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.116839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80824a-939a-46aa-a5b6-6962f4cfbb79 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.119672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.119899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.120285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.120684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.131857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.133315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.151754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29045a-d5e3-4f45-a251-c8cc0372ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:45.151905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:45.152929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:45.153803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:45.153803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:45.153803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:45.153803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:45.154027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29045a-d5e3-4f45-a251-c8cc0372ef5f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.154027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29045a-d5e3-4f45-a251-c8cc0372ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.154332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29045a-d5e3-4f45-a251-c8cc0372ef5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.158050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 324/647] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:45.158710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.194203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.226572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29045a-d5e3-4f45-a251-c8cc0372ef5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.228160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29045a-d5e3-4f45-a251-c8cc0372ef5f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.261448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c846d4-c8a3-4ba8-aace-43f059cec27f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.288915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.296395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.297731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.298013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.298296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.304922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.306358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:45.320160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:45.321027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:45.321904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 325/648] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:45.322806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.336277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 324/649] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:45.337463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29045a-d5e3-4f45-a251-c8cc0372ef5f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.420684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.427745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88276-ed75-4112-8c2a-2808c0d243f5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.445399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29045a-d5e3-4f45-a251-c8cc0372ef5f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.462437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.463197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.463483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.463762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.464503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:45.464816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.466189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.479348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 326/650] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:45.479348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.485577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.486471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.486996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.487458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.488388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:45.488873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.490431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.503672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 325/651] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:45.504667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.526801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.584927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111ea25-178a-47ff-afad-42d351d33c81 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.612339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0146f-43ab-46c2-8e5a-cd90f8986e2d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.622090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.622789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.623082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.623372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.624170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:45.624490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.625980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.638353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 327/652] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:45.639727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.655442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.657137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.657608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.658066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.667903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.671808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.674274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:45.692775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:45.693813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:45.694890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:45.694890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:45.694890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:45.694890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:45.696523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 326/653] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:45.697575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.762066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40deac-462d-4a42-9ead-89e614913606 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.773511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.799151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.799958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.800244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.800534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.805359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2dbbd-0bda-4d6b-97c5-cda375d96742 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.810566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.812071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:45.830906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:45.831851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:45.832703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:45.832703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:45.832703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:45.832703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:45.836815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 328/654] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:45.837650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.844744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.845577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.845861 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.846133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.854344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.855626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:45.869646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:45.870758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:45.871794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 327/655] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:45.872381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.915507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.948645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe625e6c-ee37-47b2-a5e9-d43d8084526c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.980767 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee62b7-155c-4404-adeb-076fc82cfb62 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.982932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.983609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.983927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.984210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.985065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=7926b212faa44c228ff4ad9e63ee0287) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:45.985380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.986850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.992874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 329/656] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/role_assignments?user.id=7926b212faa44c228ff4ad9e63ee0287&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:45.993945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.018973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.026322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.027118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.027456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.027679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.028418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:46.028959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.030400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.048633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 328/657] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:46.048633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.116782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923b097-e454-4b57-84a0-95d16f8a8842 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.155783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583ff48-9589-45aa-bf30-dfb28c5da8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.156601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ff48-9589-45aa-bf30-dfb28c5da8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.160933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ff48-9589-45aa-bf30-dfb28c5da8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.160933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ff48-9589-45aa-bf30-dfb28c5da8f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.160933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583ff48-9589-45aa-bf30-dfb28c5da8f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:46.160933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583ff48-9589-45aa-bf30-dfb28c5da8f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.160933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583ff48-9589-45aa-bf30-dfb28c5da8f5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.161765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.174819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 330/658] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:46.176127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd2e5c-fea4-4af7-9d46-18e2d0008ee3 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.176424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd2e5c-fea4-4af7-9d46-18e2d0008ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.176710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd2e5c-fea4-4af7-9d46-18e2d0008ee3 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.178208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6836322-1d0e-45f9-8b19-a37b916989d7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.182032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 331/659] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:46.182890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd2e5c-fea4-4af7-9d46-18e2d0008ee3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.225222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.225839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.226123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.226403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.227314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:46.227857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.229053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.247928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 329/660] 10.222.0.72 () {56 vars in 1137 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:46.248967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.297657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd2e5c-fea4-4af7-9d46-18e2d0008ee3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.300710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.334254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27998f8-742f-429b-87a9-d06ffbedf456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.335256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27998f8-742f-429b-87a9-d06ffbedf456 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.335555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27998f8-742f-429b-87a9-d06ffbedf456 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.336198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27998f8-742f-429b-87a9-d06ffbedf456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.343275 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27998f8-742f-429b-87a9-d06ffbedf456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.344786 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27998f8-742f-429b-87a9-d06ffbedf456 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.355400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d77d48-1f5d-40b5-b4d9-6e55d84d13fa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-c27998f8-742f-429b-87a9-d06ffbedf456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:46.358572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:46.360145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 332/661] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccd20-734f-43ab-a3de-f118776d74e4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.365562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccd20-734f-43ab-a3de-f118776d74e4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.366187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccd20-734f-43ab-a3de-f118776d74e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.381199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-8a6ccd20-734f-43ab-a3de-f118776d74e4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:46.382637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8a6ccd20-734f-43ab-a3de-f118776d74e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:46.396437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.397244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.397534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.397815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.405352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.406870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:46.421370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:46.423220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:46.424265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 330/662] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:46.424865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.439388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.458444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 333/663] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:46.459488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccd20-734f-43ab-a3de-f118776d74e4 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.547798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2844e1-9863-48e9-87fc-b998aaeb8e10 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.560622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.567329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccd20-734f-43ab-a3de-f118776d74e4 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.591139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6d19-c3d4-4a0a-9f81-3a82901a8bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.591806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6d19-c3d4-4a0a-9f81-3a82901a8bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.592088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6d19-c3d4-4a0a-9f81-3a82901a8bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.592367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6d19-c3d4-4a0a-9f81-3a82901a8bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.605084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.605909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.606201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.606481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.607373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:46.607681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.609136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.625596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 334/664] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:46.626546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.671039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c6d19-c3d4-4a0a-9f81-3a82901a8bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.673626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c6d19-c3d4-4a0a-9f81-3a82901a8bd8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.674347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.731870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe49c-9dc8-4051-81ad-e8b2228d8d02 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.766784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.767493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.767788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.768072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.768918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:46.769241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.770724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.785561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 331/665] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:46.786241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6d19-c3d4-4a0a-9f81-3a82901a8bd8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.797904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 335/666] 10.222.0.72 () {56 vars in 1139 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:46.797904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.802930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.896659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6d19-c3d4-4a0a-9f81-3a82901a8bd8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.901752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd47a-d366-42b9-85ef-0b9780080940 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.903489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.932561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d270f-f90a-4b21-96cd-9f42e2d2c5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.933355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d270f-f90a-4b21-96cd-9f42e2d2c5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.933636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d270f-f90a-4b21-96cd-9f42e2d2c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.933916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d270f-f90a-4b21-96cd-9f42e2d2c5f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.936214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.936874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.937193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.937998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.938844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=a81dce4c3ffd42bd85bf6e7687b5cbe0) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:46.939165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.940605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.944550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d270f-f90a-4b21-96cd-9f42e2d2c5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:46.946721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 336/667] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/role_assignments?user.id=a81dce4c3ffd42bd85bf6e7687b5cbe0&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:46.951723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-520d270f-f90a-4b21-96cd-9f42e2d2c5f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:46.952235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:46.953686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:46.954548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:46.959230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 332/668] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:46.960892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d270f-f90a-4b21-96cd-9f42e2d2c5f3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.042248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.083537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d270f-f90a-4b21-96cd-9f42e2d2c5f3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.126662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89744faa-88c5-44e7-a334-067332d64eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.127363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744faa-88c5-44e7-a334-067332d64eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.127655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744faa-88c5-44e7-a334-067332d64eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.127945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744faa-88c5-44e7-a334-067332d64eb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.130632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0554-c5ca-40c7-8252-669eb3fc7a6f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.169184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.172983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.172983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.172983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.188736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.190255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:47.210011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:47.211178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:47.212070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:47.212070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:47.212070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:47.212070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:47.212070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 337/669] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:47.212070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.221855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89744faa-88c5-44e7-a334-067332d64eb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.223367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89744faa-88c5-44e7-a334-067332d64eb9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.235713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.306527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.329552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce737ece-7975-43a0-ac38-bc60dbb518e1 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.339651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 333/670] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:47.340568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89744faa-88c5-44e7-a334-067332d64eb9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.367730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.368510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.368898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.369185 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.370439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:47.371184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.373966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.386160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 338/671] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:47.387047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.463444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89744faa-88c5-44e7-a334-067332d64eb9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.488092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.498538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.499238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.499528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.499837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.500776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:47.500905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.502223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.509921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a0f76-29e5-45d1-a218-054a601f6112 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.514013 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 334/672] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:47.514963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.546016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.549108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.550152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.550646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.551189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.562493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.565091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:47.584203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:47.585080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:47.586069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:47.586069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:47.586069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:47.586069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:47.588456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 339/673] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:47.589465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.618528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55104f-a4cb-4d90-b318-b77c26549135 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.652689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.653482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.653764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.654112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.664966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.666428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:47.684666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:47.685578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:47.686475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:47.686475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:47.686475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:47.686475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:47.690282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 335/674] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:47.691162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.699880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebce95a-11ef-4a97-93a3-a609ddd0c754 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.737011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.738243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.738829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.739404 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.743403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.759483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.759483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:47.776669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:47.777581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:47.778431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:47.778431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:47.778431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:47.778431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:47.778431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:47.778431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:47.778431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:47.778431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:47.778884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 340/675] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:47.780022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.791921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.796171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5e6e1-776b-4752-b7d4-e14b3b50202f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.836658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.837363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.837646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.837923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.838701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:47.839039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.840525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.854024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 336/676] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:47.854957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.898445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb19b-e7e6-43f1-8812-4049042ff4d2 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.945293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.946000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.946293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.946584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.949794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:47.950120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.951711 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.962431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc2bb-5fe1-4bb3-8dcc-93887eb308ba None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.971227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 341/677] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:47.972536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.003562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.004229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.004521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.004802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.005588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:48.005896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.007352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.020503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 337/678] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:48.021377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.024087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.042689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.109939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f4cb6-3cc4-4e6c-9db3-e92dbe7ee822 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.146663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aacad-1884-4ddd-a66d-03baee582b68 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.152833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.154174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.154648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.155350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.162763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.164459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:48.180943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:48.182002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:48.183111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:48.183111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:48.183111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:48.183111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:48.183111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:48.183111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:48.183111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:48.183111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:48.185183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 342/679] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:48.186103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.187044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.188455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.188810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.189159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] PATH_INFO: `/v3/users/swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.199302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.201411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:48.221305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:48.222496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:20:48.223691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:48.230428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 338/680] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:48.231483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.303283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ca744-a6c6-49ef-be9c-622d69d2257e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.306588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.319312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.342476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.343140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.343954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.344399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.345067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=b5188e1b57154bcba6fa56978085741d) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:48.345384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.346870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.347431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4abc-7877-44a7-92c8-10550420c1af None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.362883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 343/681] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/role_assignments?user.id=b5188e1b57154bcba6fa56978085741d&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:48.362883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.394010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5287bc0-818b-4550-98d0-e658615ff486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.395021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287bc0-818b-4550-98d0-e658615ff486 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.395390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287bc0-818b-4550-98d0-e658615ff486 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.396137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287bc0-818b-4550-98d0-e658615ff486 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.397336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5287bc0-818b-4550-98d0-e658615ff486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:48.397736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5287bc0-818b-4550-98d0-e658615ff486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.400036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5287bc0-818b-4550-98d0-e658615ff486 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.418457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 339/682] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:48.420350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd3ed-bf71-4e43-bb5d-1e3c21d70f6e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.420651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd3ed-bf71-4e43-bb5d-1e3c21d70f6e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.420938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd3ed-bf71-4e43-bb5d-1e3c21d70f6e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.423947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 340/683] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:48.424837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd3ed-bf71-4e43-bb5d-1e3c21d70f6e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.503029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c9a05-207d-405e-b3cc-aaa7ec1b2fe3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.553694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634490a9-338b-47a7-8135-9740e77398dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.554624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634490a9-338b-47a7-8135-9740e77398dc None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.555202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634490a9-338b-47a7-8135-9740e77398dc None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.555624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634490a9-338b-47a7-8135-9740e77398dc None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.555735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd3ed-bf71-4e43-bb5d-1e3c21d70f6e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.556730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634490a9-338b-47a7-8135-9740e77398dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:48.557350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634490a9-338b-47a7-8135-9740e77398dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.559780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634490a9-338b-47a7-8135-9740e77398dc None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.580558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 344/684] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:48.582107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05c58-eb50-42e5-81d3-aeb7970a71f8 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.582568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05c58-eb50-42e5-81d3-aeb7970a71f8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.583015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05c58-eb50-42e5-81d3-aeb7970a71f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.587023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.605515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.605802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4ae05c58-eb50-42e5-81d3-aeb7970a71f8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:48.606251 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.606544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.606909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.607059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4ae05c58-eb50-42e5-81d3-aeb7970a71f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:48.607819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=18d55b1fd69640548e7b35258e33e7cd) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:48.608137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.610858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.620944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 341/685] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/role_assignments?user.id=18d55b1fd69640548e7b35258e33e7cd&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:48.621567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.662338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.752686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b199f-7c52-4f6f-9f63-7e8aee8f3af4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.769070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 345/686] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:48.790894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d669bfb-fee0-4dcf-8854-1b8528a715df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.791863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669bfb-fee0-4dcf-8854-1b8528a715df None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.792311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669bfb-fee0-4dcf-8854-1b8528a715df None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.792754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669bfb-fee0-4dcf-8854-1b8528a715df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.808693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae05c58-eb50-42e5-81d3-aeb7970a71f8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.856888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.878968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d669bfb-fee0-4dcf-8854-1b8528a715df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.880391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d669bfb-fee0-4dcf-8854-1b8528a715df None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.956944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae05c58-eb50-42e5-81d3-aeb7970a71f8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.995690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be20ea-c562-4b57-bc8d-1535a61a88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.996503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be20ea-c562-4b57-bc8d-1535a61a88ce None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.996790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be20ea-c562-4b57-bc8d-1535a61a88ce None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.997070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be20ea-c562-4b57-bc8d-1535a61a88ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.009931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be20ea-c562-4b57-bc8d-1535a61a88ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-b8be20ea-c562-4b57-bc8d-1535a61a88ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:49.018278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:49.019263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:49.020079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:49.020729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 346/687] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:49.021406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 342/688] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:49.025862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be20ea-c562-4b57-bc8d-1535a61a88ce None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.031501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d669bfb-fee0-4dcf-8854-1b8528a715df None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.066579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.154327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.163360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d669bfb-fee0-4dcf-8854-1b8528a715df None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.200672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be20ea-c562-4b57-bc8d-1535a61a88ce None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.232433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589a147-1385-4cde-b1c1-6fbd355c8961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.233248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a147-1385-4cde-b1c1-6fbd355c8961 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.233545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a147-1385-4cde-b1c1-6fbd355c8961 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.233859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a147-1385-4cde-b1c1-6fbd355c8961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.244511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a147-1385-4cde-b1c1-6fbd355c8961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.245967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a147-1385-4cde-b1c1-6fbd355c8961 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.261402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7628-8ed1-4ff2-91fe-986587764155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.262090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7628-8ed1-4ff2-91fe-986587764155 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.262380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7628-8ed1-4ff2-91fe-986587764155 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.262666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7628-8ed1-4ff2-91fe-986587764155 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.263459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7628-8ed1-4ff2-91fe-986587764155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:49.263772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7628-8ed1-4ff2-91fe-986587764155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.265225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7628-8ed1-4ff2-91fe-986587764155 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5589a147-1385-4cde-b1c1-6fbd355c8961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:49.265975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:49.266898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:49.267760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:49.267760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:49.267760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:49.267760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:49.269866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 343/689] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:49.271327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34e31-8a5f-4e56-a146-688675c91cd4 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.271796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34e31-8a5f-4e56-a146-688675c91cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.272261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34e31-8a5f-4e56-a146-688675c91cd4 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.273960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 344/690] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:49.279083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34e31-8a5f-4e56-a146-688675c91cd4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.284049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 347/691] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:49.291125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdada6-3008-4769-a913-b1fff7250417 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.291645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdada6-3008-4769-a913-b1fff7250417 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.293310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdada6-3008-4769-a913-b1fff7250417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.314746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4dfdada6-3008-4769-a913-b1fff7250417 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:49.316783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4dfdada6-3008-4769-a913-b1fff7250417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:49.392034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 348/692] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:49.393162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdada6-3008-4769-a913-b1fff7250417 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.407471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34e31-8a5f-4e56-a146-688675c91cd4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.420609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.468399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.469073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.469361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.469640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.470370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:49.470678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.472066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.481834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.495068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 345/693] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:49.496205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.522181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdada6-3008-4769-a913-b1fff7250417 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.559023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.559835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.560120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.560391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.572069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.573689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:49.591718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:49.592620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:49.593527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:49.593527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:49.593527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:49.593527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:49.597607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 349/694] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:49.598492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.631331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21501e5-5d44-4ac4-aaf0-41ee752e94bd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.673237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.673970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.674262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.674547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.686586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.688854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.689417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:49.710342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:49.711342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:49.712265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:49.712265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:49.712265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:49.712265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:49.714605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 346/695] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:49.715647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.728737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3e82a-8f05-4c8c-a14a-3dfad0a1f4e8 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.771520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.774068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.774907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.775596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.775895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.786481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.788893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:49.807869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:49.808792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:49.809675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 350/696] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:49.810149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.833119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bab18b-a49b-444f-9fbc-602ced5197fd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.880647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.881556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.881857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.882142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.883403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:49.883725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.885358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.899621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 347/697] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:49.900646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.941279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a2858-cf70-40a2-9607-01a1d9ed654b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.977654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.989208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.990349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.990641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.990950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.991957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:49.992272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.993900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.013480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 351/698] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:50.014352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.024301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cccfd-6006-44fc-8ced-7341609b9e9e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.047457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:50.094330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.095435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.095955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.096443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.097491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:50.098029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.099885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.114047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 348/699] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:50.116143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.164883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2dc30-bb3c-46d0-af17-15bee8dfb7e8 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.222186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.222955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.224058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.224058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.230383 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d9475-fcd6-49c3-9a18-ad839b8a7d94 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.239619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.241093 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.274751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916d2eb-8a9e-4ace-af36-ce042ab99700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:50.275744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:50.276697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:50.277618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:50.278729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916d2eb-8a9e-4ace-af36-ce042ab99700 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.279256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916d2eb-8a9e-4ace-af36-ce042ab99700 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.279719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 352/700] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:20:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:50.280209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916d2eb-8a9e-4ace-af36-ce042ab99700 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.280468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.281963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916d2eb-8a9e-4ace-af36-ce042ab99700 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.283697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916d2eb-8a9e-4ace-af36-ce042ab99700 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.307193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 349/701] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:50 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:50.308616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916d2eb-8a9e-4ace-af36-ce042ab99700 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.343798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:50.360526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:50.474064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78077e1-fd1f-4ed4-b2e9-5475ac05c996 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.543371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916d2eb-8a9e-4ace-af36-ce042ab99700 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.586646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.587378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.587667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.587945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.588793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:50.589106 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.590539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.601581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d36b8-9f67-4cfd-8fb0-a7e0617e734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.602272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d36b8-9f67-4cfd-8fb0-a7e0617e734c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.602558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d36b8-9f67-4cfd-8fb0-a7e0617e734c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.602880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d36b8-9f67-4cfd-8fb0-a7e0617e734c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.603728 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d36b8-9f67-4cfd-8fb0-a7e0617e734c None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=9422f3bea364469093eb4046b011017e) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:50.604048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d36b8-9f67-4cfd-8fb0-a7e0617e734c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.605513 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d36b8-9f67-4cfd-8fb0-a7e0617e734c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.619643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 350/702] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:20:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:50.627184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 353/703] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:50 2022] GET /identity/v3/role_assignments?user.id=9422f3bea364469093eb4046b011017e&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:50.637674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.746404 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb03820-2eb4-4fe8-991d-3e1ca5985358 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.747077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb03820-2eb4-4fe8-991d-3e1ca5985358 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.747575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb03820-2eb4-4fe8-991d-3e1ca5985358 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.750069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 354/704] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:50.759787 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeeeaf-aa53-42f0-9dfc-1ae3c6b64711 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.760103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeeeaf-aa53-42f0-9dfc-1ae3c6b64711 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.760354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeeeaf-aa53-42f0-9dfc-1ae3c6b64711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.785323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:50.787036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1aaeeeaf-aa53-42f0-9dfc-1ae3c6b64711 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:50.788538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1aaeeeaf-aa53-42f0-9dfc-1ae3c6b64711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:50.808080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c769ea-43da-4f6a-b11f-12e4472e7dd5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.859648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630870b7-c6eb-4b96-bca3-16a8bdd18e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.860633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630870b7-c6eb-4b96-bca3-16a8bdd18e0f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.860769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630870b7-c6eb-4b96-bca3-16a8bdd18e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.860975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630870b7-c6eb-4b96-bca3-16a8bdd18e0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.872823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 355/705] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:50.897370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeeeaf-aa53-42f0-9dfc-1ae3c6b64711 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.936019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630870b7-c6eb-4b96-bca3-16a8bdd18e0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.938055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630870b7-c6eb-4b96-bca3-16a8bdd18e0f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.944297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.006522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeeeaf-aa53-42f0-9dfc-1ae3c6b64711 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.029837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.047872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.048854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.049242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.049384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 351/706] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:51.051420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.051420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.053549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.055616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630870b7-c6eb-4b96-bca3-16a8bdd18e0f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:51.073266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:51.074452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:20:51.075581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:51.077722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 356/707] 10.222.0.72 () {56 vars in 1129 bytes} [Tue Jul 12 14:20:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:51.083289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.168430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630870b7-c6eb-4b96-bca3-16a8bdd18e0f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.192789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ee29-ba6d-4ed0-b247-7b1fb3494dc4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.202090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.206227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557fbe5-9dab-41bf-aabb-843f51392337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.207608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fbe5-9dab-41bf-aabb-843f51392337 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.207608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fbe5-9dab-41bf-aabb-843f51392337 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.208038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fbe5-9dab-41bf-aabb-843f51392337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.219890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557fbe5-9dab-41bf-aabb-843f51392337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.221439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557fbe5-9dab-41bf-aabb-843f51392337 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.239340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dab8c7-0e57-4906-b389-e84ec7fc344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.240013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dab8c7-0e57-4906-b389-e84ec7fc344a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.240300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dab8c7-0e57-4906-b389-e84ec7fc344a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.240584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dab8c7-0e57-4906-b389-e84ec7fc344a None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.241299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dab8c7-0e57-4906-b389-e84ec7fc344a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2557fbe5-9dab-41bf-aabb-843f51392337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:51.241563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:51.242604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:51.243900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:51.243900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:51.243900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:51.243900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:51.244525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dab8c7-0e57-4906-b389-e84ec7fc344a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.244525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dab8c7-0e57-4906-b389-e84ec7fc344a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.244904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 352/708] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:51.248262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbab91-b245-4e37-87c7-f53ba9464b53 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.248262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbab91-b245-4e37-87c7-f53ba9464b53 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.248262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbab91-b245-4e37-87c7-f53ba9464b53 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.248262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 353/709] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:51.248720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 357/710] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:51.249607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbab91-b245-4e37-87c7-f53ba9464b53 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.256695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aaba4-9969-4e73-a015-e2de2ef770ea None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.256928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aaba4-9969-4e73-a015-e2de2ef770ea None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.257213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aaba4-9969-4e73-a015-e2de2ef770ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.276134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-3e0aaba4-9969-4e73-a015-e2de2ef770ea None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:51.277467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3e0aaba4-9969-4e73-a015-e2de2ef770ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:51.290109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.352191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 358/711] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:51.353176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aaba4-9969-4e73-a015-e2de2ef770ea None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.358087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbab91-b245-4e37-87c7-f53ba9464b53 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.396904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.397745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.398141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.398551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.399443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:51.399860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.401337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.414342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 354/712] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:51.415455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.484429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.488207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aaba4-9969-4e73-a015-e2de2ef770ea None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.523229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.528186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfcafd-f53e-4c13-ada3-9e873ae5fb23 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.531650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.532572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.533082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.533572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.534478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:51.535003 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.536583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.551077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 359/713] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:51.552423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.568913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.568913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.568913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.568913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] PATH_INFO: `/v3/services/network` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.569662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.570848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:51.586255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:51.587412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:51.588242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 355/714] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:51.598796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.706803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506451e-25a3-49f9-8edd-ccf9e0540d86 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.741169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.741803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55d5ff-3965-47c7-ae12-af1f3b4eb3e2 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.741913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.742142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.742436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.743271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:51.743588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.745113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.750782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 356/715] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:51.762798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.791280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.813489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.817973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.818394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.818685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.836420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.839518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:51.865729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:51.866663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:51.867564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:51.867564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:51.867564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:51.867564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:51.867564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:51.867564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:51.867564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:51.867564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:51.870116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 360/716] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:51.879814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.891576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c2a9-b557-4a3c-a914-553d896a66d2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.932436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.933074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.933187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.934158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.934446 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.935200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] RBAC: Adding query filter params (type=network) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:51.935517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.937895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.959247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 357/717] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:52.063708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff3d8e-fcd3-42ee-ada4-1bbcd9e93216 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.128511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19402ec8-9c4b-4743-8f53-12777beea19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.129265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19402ec8-9c4b-4743-8f53-12777beea19f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.129559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19402ec8-9c4b-4743-8f53-12777beea19f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.129842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19402ec8-9c4b-4743-8f53-12777beea19f None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.130650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19402ec8-9c4b-4743-8f53-12777beea19f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:52.130987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19402ec8-9c4b-4743-8f53-12777beea19f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.132491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19402ec8-9c4b-4743-8f53-12777beea19f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.150691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 361/718] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:52.156541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.262389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.275389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd16ed-f8a4-48af-b1a5-0b5b0310787c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.311052 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cbf4f-6881-412e-a529-3ce8c0865502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.312445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cbf4f-6881-412e-a529-3ce8c0865502 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.313090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cbf4f-6881-412e-a529-3ce8c0865502 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.313375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cbf4f-6881-412e-a529-3ce8c0865502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.314284 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cbf4f-6881-412e-a529-3ce8c0865502 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=7926b212faa44c228ff4ad9e63ee0287) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:52.314549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cbf4f-6881-412e-a529-3ce8c0865502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.316035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cbf4f-6881-412e-a529-3ce8c0865502 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.322253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 358/719] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/role_assignments?user.id=7926b212faa44c228ff4ad9e63ee0287&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:53.024086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec74b-e028-46ce-9c84-95ede186e5ea None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.024615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec74b-e028-46ce-9c84-95ede186e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.024944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec74b-e028-46ce-9c84-95ede186e5ea None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.026641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 362/720] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:53.032949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755172-e7da-4d56-b1e8-46f7fff5ee47 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.033379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755172-e7da-4d56-b1e8-46f7fff5ee47 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.033725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755172-e7da-4d56-b1e8-46f7fff5ee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.051632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2a755172-e7da-4d56-b1e8-46f7fff5ee47 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:53.052893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2a755172-e7da-4d56-b1e8-46f7fff5ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:53.122836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 359/721] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:53.146531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec74b-e028-46ce-9c84-95ede186e5ea None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.254800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.276450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec74b-e028-46ce-9c84-95ede186e5ea None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.310645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b85838-3064-4f4e-947a-813529d760a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.312051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b85838-3064-4f4e-947a-813529d760a5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.312342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b85838-3064-4f4e-947a-813529d760a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.312625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b85838-3064-4f4e-947a-813529d760a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.323505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b85838-3064-4f4e-947a-813529d760a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-a6b85838-3064-4f4e-947a-813529d760a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:53.331145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:53.332111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:53.333387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 363/722] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:53.338538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a755172-e7da-4d56-b1e8-46f7fff5ee47 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.427188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.446540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a755172-e7da-4d56-b1e8-46f7fff5ee47 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.482550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2f0d0-365f-41a5-8818-662acb119f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.483315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f0d0-365f-41a5-8818-662acb119f6d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.484098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f0d0-365f-41a5-8818-662acb119f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.484382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f0d0-365f-41a5-8818-662acb119f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.485135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2f0d0-365f-41a5-8818-662acb119f6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:53.485448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2f0d0-365f-41a5-8818-662acb119f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.486852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2f0d0-365f-41a5-8818-662acb119f6d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.495409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 360/723] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:53.501033 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b85838-3064-4f4e-947a-813529d760a5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.611381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b85838-3064-4f4e-947a-813529d760a5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.612848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170e48-90b2-4b01-9871-93e8cdeb9686 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.613147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170e48-90b2-4b01-9871-93e8cdeb9686 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.613435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170e48-90b2-4b01-9871-93e8cdeb9686 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.614831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 361/724] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:53.620921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc20a-80eb-41cf-b154-450800554947 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.621215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc20a-80eb-41cf-b154-450800554947 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.621503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc20a-80eb-41cf-b154-450800554947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.640345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cd9fc20a-80eb-41cf-b154-450800554947 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:53.641675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cd9fc20a-80eb-41cf-b154-450800554947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:53.679570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.680384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.680669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.680949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.699765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.701250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.719106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:53.736221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:53.737195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:53.738493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:53.738493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:53.738493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:53.738493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:53.738493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 364/725] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:53.743909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.771076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 362/726] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:53.853647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fc20a-80eb-41cf-b154-450800554947 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.916844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e74cc-781e-4595-93b4-daa79b0b37ab None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.981442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.988888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.989571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.989855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.990131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.990900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:53.991212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.992612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.013564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 365/727] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.019751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.038594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fc20a-80eb-41cf-b154-450800554947 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.095806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.109241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222d01-94cc-447b-914b-ee04ce1e8819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.110052 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222d01-94cc-447b-914b-ee04ce1e8819 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.110341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222d01-94cc-447b-914b-ee04ce1e8819 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.110680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222d01-94cc-447b-914b-ee04ce1e8819 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.126186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22222d01-94cc-447b-914b-ee04ce1e8819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-22222d01-94cc-447b-914b-ee04ce1e8819 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:54.136950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:54.137857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:54.138696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:54.142222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 363/728] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:54.143706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17e1b-e7be-44db-8519-bcc46a4c9aa4 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.144140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17e1b-e7be-44db-8519-bcc46a4c9aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.144556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17e1b-e7be-44db-8519-bcc46a4c9aa4 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.146231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 364/729] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:54.147772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b17e1b-e7be-44db-8519-bcc46a4c9aa4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.157020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e294008-9030-48f7-b21d-3e9da5d0db90 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.192371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df5ba7-65f7-4072-af13-0c207cab098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.193307 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df5ba7-65f7-4072-af13-0c207cab098a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.193694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df5ba7-65f7-4072-af13-0c207cab098a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.194089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df5ba7-65f7-4072-af13-0c207cab098a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.201789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df5ba7-65f7-4072-af13-0c207cab098a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.203972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df5ba7-65f7-4072-af13-0c207cab098a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d3df5ba7-65f7-4072-af13-0c207cab098a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:54.225672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:54.226820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:20:54.227940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:54.230901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 366/730] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:54.232259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15adbe-8f92-467b-8bad-76a6341af144 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.232676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15adbe-8f92-467b-8bad-76a6341af144 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.233081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15adbe-8f92-467b-8bad-76a6341af144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.254709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-fa15adbe-8f92-467b-8bad-76a6341af144 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:54.256801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fa15adbe-8f92-467b-8bad-76a6341af144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:54.280482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b17e1b-e7be-44db-8519-bcc46a4c9aa4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.318074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.319120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.319362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.319752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.320659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:54.321069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.322535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.324249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.338135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 365/731] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.339323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.348415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 367/732] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:54.349910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15adbe-8f92-467b-8bad-76a6341af144 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.407566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.458552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a262-1d84-452b-9595-bbbfe770a0e1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.466206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15adbe-8f92-467b-8bad-76a6341af144 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.501112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.501954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.502361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.502743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.503711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:54.504126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.504426 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a3f79-8db4-4556-8e5f-1decf487df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.505384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3f79-8db4-4556-8e5f-1decf487df26 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.505805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3f79-8db4-4556-8e5f-1decf487df26 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.505928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.506324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3f79-8db4-4556-8e5f-1decf487df26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.519449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a3f79-8db4-4556-8e5f-1decf487df26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.521121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a3f79-8db4-4556-8e5f-1decf487df26 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.526989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 366/733] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.527853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-4c3a3f79-8db4-4556-8e5f-1decf487df26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:54.542834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:54.543758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:54.544636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:54.544636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:54.544636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:54.544636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:54.544636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 368/734] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:54.545766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ef1a-6ea8-42d5-acff-c3c39bf3121e None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.545766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ef1a-6ea8-42d5-acff-c3c39bf3121e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.545942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ef1a-6ea8-42d5-acff-c3c39bf3121e None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.547267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 369/735] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:54.547801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ef1a-6ea8-42d5-acff-c3c39bf3121e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.600048 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.653589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.654466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd91ca-0e00-42e1-9c6e-3c5239bef4a9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.660154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ef1a-6ea8-42d5-acff-c3c39bf3121e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.691851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9f948-0726-4000-9e04-fefe515807c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.692751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f948-0726-4000-9e04-fefe515807c0 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.693216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f948-0726-4000-9e04-fefe515807c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.693540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f948-0726-4000-9e04-fefe515807c0 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.694217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9f948-0726-4000-9e04-fefe515807c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.695606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9f948-0726-4000-9e04-fefe515807c0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.697688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10143d-7e3d-4595-9576-26f7b57f5067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.698353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10143d-7e3d-4595-9576-26f7b57f5067 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.698645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10143d-7e3d-4595-9576-26f7b57f5067 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.698973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10143d-7e3d-4595-9576-26f7b57f5067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.711262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 367/736] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:20:54 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:54.712148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9f948-0726-4000-9e04-fefe515807c0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.792755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10143d-7e3d-4595-9576-26f7b57f5067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.794615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10143d-7e3d-4595-9576-26f7b57f5067 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.844117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9f948-0726-4000-9e04-fefe515807c0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.856698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.887691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4037f2a-44f7-45f2-a324-019f049efdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.888376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4037f2a-44f7-45f2-a324-019f049efdcb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.888665 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4037f2a-44f7-45f2-a324-019f049efdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.888954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4037f2a-44f7-45f2-a324-019f049efdcb None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.889740 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4037f2a-44f7-45f2-a324-019f049efdcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:54.890054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4037f2a-44f7-45f2-a324-019f049efdcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.891497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4037f2a-44f7-45f2-a324-019f049efdcb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.906387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 368/737] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.907943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cfbee-99d1-4d2c-b4df-bd0438335ec5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.909109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cfbee-99d1-4d2c-b4df-bd0438335ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.909109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cfbee-99d1-4d2c-b4df-bd0438335ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.912418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.923286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 370/738] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:54.924202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca2abd-b50f-42d6-bdbb-340159accbe8 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.924202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca2abd-b50f-42d6-bdbb-340159accbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.924401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca2abd-b50f-42d6-bdbb-340159accbe8 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.925792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 371/739] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:54.926430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca2abd-b50f-42d6-bdbb-340159accbe8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.928864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7c8cfbee-99d1-4d2c-b4df-bd0438335ec5 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:54.930085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7c8cfbee-99d1-4d2c-b4df-bd0438335ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:54.998945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 369/740] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:55.003981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cfbee-99d1-4d2c-b4df-bd0438335ec5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.041426 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca2abd-b50f-42d6-bdbb-340159accbe8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.082105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a0232-2c79-4440-a9f8-814e5b7fd047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.082890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0232-2c79-4440-a9f8-814e5b7fd047 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.083172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0232-2c79-4440-a9f8-814e5b7fd047 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.084138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0232-2c79-4440-a9f8-814e5b7fd047 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.090992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a0232-2c79-4440-a9f8-814e5b7fd047 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:55.092991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a0232-2c79-4440-a9f8-814e5b7fd047 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-853a0232-2c79-4440-a9f8-814e5b7fd047 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:55.107953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:55.109850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 372/741] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326219-58f8-40ce-86a8-4e47df09cf7d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.111520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326219-58f8-40ce-86a8-4e47df09cf7d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.112255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b326219-58f8-40ce-86a8-4e47df09cf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.117666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.120340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cfbee-99d1-4d2c-b4df-bd0438335ec5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.129349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4b326219-58f8-40ce-86a8-4e47df09cf7d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:55.130827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4b326219-58f8-40ce-86a8-4e47df09cf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:55.157772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.158726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.159120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.159475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.169857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:55.171984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:55.189197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:55.189679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:55.190597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:55.191489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:55.191489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:55.191489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:55.191489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:55.191489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 370/742] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:55.192113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.208544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 373/743] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:55.209570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b326219-58f8-40ce-86a8-4e47df09cf7d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.310511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae91fa-b445-490b-bbe5-1a43fbc53efb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.321677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b326219-58f8-40ce-86a8-4e47df09cf7d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.346352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d5fa8-9390-4559-8b22-891748458a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.347062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d5fa8-9390-4559-8b22-891748458a03 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.347412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d5fa8-9390-4559-8b22-891748458a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.347702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d5fa8-9390-4559-8b22-891748458a03 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.348476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d5fa8-9390-4559-8b22-891748458a03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:55.349846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d5fa8-9390-4559-8b22-891748458a03 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:55.358753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.359516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.359807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.360094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.360990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:55.361312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:55.362803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:55.364190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 371/744] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:20:55 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:55.364792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d5fa8-9390-4559-8b22-891748458a03 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.393377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.394379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 374/745] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:55.395720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.452614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.508719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d5fa8-9390-4559-8b22-891748458a03 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.516220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bedce2-9d41-41fa-bca9-55145cf30515 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.548981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.549769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.550169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.550558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.551550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:55.552037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:55.554122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:55.554696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f90e-140a-4310-ba2d-05f38bef6971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.555577 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f90e-140a-4310-ba2d-05f38bef6971 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.555824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f90e-140a-4310-ba2d-05f38bef6971 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.556107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f90e-140a-4310-ba2d-05f38bef6971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.566813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 372/746] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:55.567582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.574150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4f90e-140a-4310-ba2d-05f38bef6971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-afd4f90e-140a-4310-ba2d-05f38bef6971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:55.582739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:55.583676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:55.584521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 375/747] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:55.585198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f90e-140a-4310-ba2d-05f38bef6971 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.658569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.694817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76173c1-e179-4578-9a3c-e6650a2cdec9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.699573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f90e-140a-4310-ba2d-05f38bef6971 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.708557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.733854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68eaca-1475-4e7d-9915-4a47e120d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.734937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68eaca-1475-4e7d-9915-4a47e120d530 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.735457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68eaca-1475-4e7d-9915-4a47e120d530 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.735953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68eaca-1475-4e7d-9915-4a47e120d530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.740192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.740815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.741112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.741393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.749150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:55.750738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:55.767941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:55.768866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:55.769724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:55.769724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:55.769724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:55.769724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:55.769724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:55.769724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:55.769724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:55.769724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:55.773871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 376/748] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:55.774731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.813571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68eaca-1475-4e7d-9915-4a47e120d530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:55.815497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68eaca-1475-4e7d-9915-4a47e120d530 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:55.888475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.894625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81d010-f501-40ed-af35-6c73e966dfd2 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.928503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 373/749] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:20:55.929443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68eaca-1475-4e7d-9915-4a47e120d530 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.933883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.934735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.935191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.935609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.937054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:55.937502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:55.939484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:55.948925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 377/750] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:55.949940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.003165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.031761 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68eaca-1475-4e7d-9915-4a47e120d530 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.057412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598ba5e-b3ee-497a-80fd-bbd42a95e60e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.075269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.076018 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.076416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.077322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.078347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:56.078731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.080570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.095637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 374/751] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:56.096568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.097964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.099012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.099660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.100287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.111982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.114288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.129142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:56.134463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:56.138204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:56.139189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:56.139189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:56.139189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:56.139189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:56.139189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 378/752] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:56.139189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.206084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7585b2-b466-44d2-9838-030de0d23929 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.239148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.249360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.250320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.250685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.251320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.261746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28999ca-20cd-4cfc-a72f-531468475953 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.265961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.267522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:56.290073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:56.291027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:56.291876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:56.291876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:56.291876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:56.291876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:56.291876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 375/753] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:56.293088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.305353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.306566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.306949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.307303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.308717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=6c7f048f7f1c4df1a9f6dca0fc4ce75a) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:56.309107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.311774 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.319973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 379/754] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/role_assignments?user.id=6c7f048f7f1c4df1a9f6dca0fc4ce75a&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:56.321144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.399119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.448105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1ff8d-04ae-4fdb-b8fb-a563e8e9f35b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.470150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc91b5-683f-4084-a3f5-015922fb157b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.528363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.531542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.532043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.532662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.533956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:56.534489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.536677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.546796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.546796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.546796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.546796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.547177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:56.547177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.547177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.560071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 376/755] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:56.567389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.569867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 380/756] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:56.574739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.583107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.759383 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd760d48-d30a-4708-aa5a-819c787314c4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.774079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df7440-7913-407d-8026-2f0d097fedca None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.812271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.813144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.813445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.813707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.821443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.823017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:56.845657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:56.846679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:56.847649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 381/757] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:56.853168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.858511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae175d3e-d686-45bc-9a80-b68f45c7c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.859465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae175d3e-d686-45bc-9a80-b68f45c7c45c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.859821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae175d3e-d686-45bc-9a80-b68f45c7c45c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.860185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae175d3e-d686-45bc-9a80-b68f45c7c45c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.867427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae175d3e-d686-45bc-9a80-b68f45c7c45c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.869052 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae175d3e-d686-45bc-9a80-b68f45c7c45c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.871711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ae175d3e-d686-45bc-9a80-b68f45c7c45c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:56.885224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:56.886127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:56.887039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 377/758] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:56.887846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a958ba-a5dc-4d50-8781-6b459db363a6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.893164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a958ba-a5dc-4d50-8781-6b459db363a6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.893525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a958ba-a5dc-4d50-8781-6b459db363a6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.895169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 378/759] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:56.895947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a958ba-a5dc-4d50-8781-6b459db363a6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.928270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.970803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd282f-32ff-4f6a-83f0-6ee6e6286a5e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.014863 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34b512-1855-4d37-958a-1c68e3736b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.015657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b512-1855-4d37-958a-1c68e3736b52 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.016016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b512-1855-4d37-958a-1c68e3736b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.016364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b512-1855-4d37-958a-1c68e3736b52 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.016664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a958ba-a5dc-4d50-8781-6b459db363a6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.017337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b512-1855-4d37-958a-1c68e3736b52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:57.017735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b512-1855-4d37-958a-1c68e3736b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.020389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b512-1855-4d37-958a-1c68e3736b52 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.048295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 382/760] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:57.050122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbe068-b961-4832-a6d4-115ed3ab1c32 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.050485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbe068-b961-4832-a6d4-115ed3ab1c32 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.050859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbe068-b961-4832-a6d4-115ed3ab1c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.064263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.065313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.065783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.066236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.067275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:57.067800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.070191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-2dfbe068-b961-4832-a6d4-115ed3ab1c32 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:57.070309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.071492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2dfbe068-b961-4832-a6d4-115ed3ab1c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:57.086078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 379/761] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:57.087428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.153925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.169427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 383/762] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:20:57.170348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbe068-b961-4832-a6d4-115ed3ab1c32 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.208015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4277d-7185-41c7-baf3-b13050f773c9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.227743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.252358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.253572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.253868 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.254148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.269380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.270973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.280267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbe068-b961-4832-a6d4-115ed3ab1c32 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:57.292886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:57.293803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:57.294656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:57.294656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:57.294656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:57.294656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:57.294656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 380/763] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:57.299277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.321828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.322968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.323523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.324043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.325107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=9422f3bea364469093eb4046b011017e) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:57.325642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.328053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.335368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 384/764] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/role_assignments?user.id=9422f3bea364469093eb4046b011017e&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:57.336572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.515496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc416a-3ae3-4497-bac2-ae7277cc5ad9 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.538874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.562536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.563253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.563564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.564032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.564554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:57.564865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.566253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.582356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 385/765] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:57.598903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.635175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5151b-ec5e-4181-b453-06d9125232dd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.649391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.672908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071315ad-9333-4d84-8923-a4b4b9603e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.674103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071315ad-9333-4d84-8923-a4b4b9603e20 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.674532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071315ad-9333-4d84-8923-a4b4b9603e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.675002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071315ad-9333-4d84-8923-a4b4b9603e20 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.675802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071315ad-9333-4d84-8923-a4b4b9603e20 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.677328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071315ad-9333-4d84-8923-a4b4b9603e20 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-071315ad-9333-4d84-8923-a4b4b9603e20 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:57.690247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:57.691191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:20:57.692058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:57.694546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 381/766] 10.222.0.72 () {56 vars in 1129 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:57.696133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29dfe6-3e36-406b-911c-ae18062b6e7d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.696563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29dfe6-3e36-406b-911c-ae18062b6e7d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.696972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29dfe6-3e36-406b-911c-ae18062b6e7d None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.698652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 382/767] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:57.700154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29dfe6-3e36-406b-911c-ae18062b6e7d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.720142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc89cb-a9ef-48ca-af6c-3451ab867354 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.756678 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e757493-f0e1-439e-bb2f-59a3b069ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.757891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e757493-f0e1-439e-bb2f-59a3b069ea0d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.758282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e757493-f0e1-439e-bb2f-59a3b069ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.758663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e757493-f0e1-439e-bb2f-59a3b069ea0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.767715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e757493-f0e1-439e-bb2f-59a3b069ea0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.769967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e757493-f0e1-439e-bb2f-59a3b069ea0d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-1e757493-f0e1-439e-bb2f-59a3b069ea0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:20:57.798245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:57.799299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:57.800156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:20:57.800156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:20:57.800156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:20:57.800156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:20:57.800156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:20:57.800156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:20:57.800156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:20:57.800156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:57.805784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 386/768] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:57.805784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a871-b9d6-4e2a-96e6-883aaa6085f7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.805784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a871-b9d6-4e2a-96e6-883aaa6085f7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.805784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a871-b9d6-4e2a-96e6-883aaa6085f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.828142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b487a871-b9d6-4e2a-96e6-883aaa6085f7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:57.828700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29dfe6-3e36-406b-911c-ae18062b6e7d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.829814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b487a871-b9d6-4e2a-96e6-883aaa6085f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:57.863209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.874340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.875189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.875552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.876251 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.877498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:57.879796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.881315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.888939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 383/769] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:57.889762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.913780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 387/770] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:20:57.914976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487a871-b9d6-4e2a-96e6-883aaa6085f7 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.945010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.012471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcfbe8-de2b-42d1-8f90-8a667bc44e10 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.038366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487a871-b9d6-4e2a-96e6-883aaa6085f7 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.051591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.052595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.053146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.053718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.054700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:58.055232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.057051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.075255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 384/771] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:58.076467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.078813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.079665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.080012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.080300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.081749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:58.081749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.082939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.088858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 388/772] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:58.089718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.123990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.180393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.184021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e542faa-2e0e-4f73-8102-53077e56a85e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.203531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cadee-7814-437c-a453-a00a21691ef0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.220285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.221417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.221902 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.222373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] PATH_INFO: `/v3/services/network` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.223265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.224855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:58.237400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:58.238371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:20:58.239199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:58.241705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8abb9-ab8f-4297-98c0-e96befa6a991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.242157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 385/773] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:58.242512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8abb9-ab8f-4297-98c0-e96befa6a991 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.242825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8abb9-ab8f-4297-98c0-e96befa6a991 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.243111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8abb9-ab8f-4297-98c0-e96befa6a991 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/7926b212faa44c228ff4ad9e63ee0287/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.243841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.245160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8abb9-ab8f-4297-98c0-e96befa6a991 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=7926b212faa44c228ff4ad9e63ee0287, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.246663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8abb9-ab8f-4297-98c0-e96befa6a991 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.262994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 389/774] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:58 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/7926b212faa44c228ff4ad9e63ee0287/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:58.271231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8abb9-ab8f-4297-98c0-e96befa6a991 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.372973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a0859-a77c-4f1a-a18e-263615f8482e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.417632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.440146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8abb9-ab8f-4297-98c0-e96befa6a991 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.468511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.469205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.469490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.469768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.470579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] RBAC: Adding query filter params (interface=public, service_id=129dd44f6c96488abd93b10c76df03de, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:58.470923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.472718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.486562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 386/775] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/endpoints?service_id=129dd44f6c96488abd93b10c76df03de&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:58.492641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.512087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.513415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.514002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.514620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.515976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] RBAC: Adding query filter params (name=network) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:58.516726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.518471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.524806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 390/776] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:58.530994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.533776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.633600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317613f2-2ae0-468f-b52a-c19b12e4d37b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.647509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d09b98-ba85-4f19-bd29-0a38fad89a7b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.684712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39b17-056b-4f4d-a67a-9f5749b7993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.686035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39b17-056b-4f4d-a67a-9f5749b7993e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.686526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39b17-056b-4f4d-a67a-9f5749b7993e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.687035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39b17-056b-4f4d-a67a-9f5749b7993e None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.687924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e39b17-056b-4f4d-a67a-9f5749b7993e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.689177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e266c2a-c750-43aa-b086-666930981e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.689764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e39b17-056b-4f4d-a67a-9f5749b7993e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.689870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e266c2a-c750-43aa-b086-666930981e93 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.690132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e266c2a-c750-43aa-b086-666930981e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.690418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e266c2a-c750-43aa-b086-666930981e93 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.691166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e266c2a-c750-43aa-b086-666930981e93 None admin] RBAC: Adding query filter params (type=network) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:58.691481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e266c2a-c750-43aa-b086-666930981e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.693062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e266c2a-c750-43aa-b086-666930981e93 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.697892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 387/777] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:58.699418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3133a-fd42-48c2-8d40-ea995114eb47 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.699912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3133a-fd42-48c2-8d40-ea995114eb47 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.700429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3133a-fd42-48c2-8d40-ea995114eb47 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.702337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 388/778] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:58.702694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 391/779] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:58.707886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3133a-fd42-48c2-8d40-ea995114eb47 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.712895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca592-3f0a-48ef-bf1c-f51e4a6cd0f8 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.713067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca592-3f0a-48ef-bf1c-f51e4a6cd0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.713372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca592-3f0a-48ef-bf1c-f51e4a6cd0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.756024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-291ca592-3f0a-48ef-bf1c-f51e4a6cd0f8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:58.757465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-291ca592-3f0a-48ef-bf1c-f51e4a6cd0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:58.781483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.818861 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.832471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3133a-fd42-48c2-8d40-ea995114eb47 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.872726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.873811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.874304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.874836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.875885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] RBAC: Adding query filter params (interface=public, service_id=db70359394d44fc98c6e67f5efa83286, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:58.876481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.878177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.878921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 392/780] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:20:58.885181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 389/781] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/endpoints?service_id=db70359394d44fc98c6e67f5efa83286&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:58.891487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca592-3f0a-48ef-bf1c-f51e4a6cd0f8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.898482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.049328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50412bf0-9828-496f-88ee-14d22e7e91a0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.050976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca592-3f0a-48ef-bf1c-f51e4a6cd0f8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.095612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239e4f9-f99e-413d-a51f-d9c6ea6e2044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.096520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e69ad-3e8d-4d59-b05c-c42924a99189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.096651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239e4f9-f99e-413d-a51f-d9c6ea6e2044 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.097006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239e4f9-f99e-413d-a51f-d9c6ea6e2044 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.097327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e69ad-3e8d-4d59-b05c-c42924a99189 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.097448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239e4f9-f99e-413d-a51f-d9c6ea6e2044 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.097615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e69ad-3e8d-4d59-b05c-c42924a99189 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.097893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e69ad-3e8d-4d59-b05c-c42924a99189 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.098510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239e4f9-f99e-413d-a51f-d9c6ea6e2044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:59.100366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239e4f9-f99e-413d-a51f-d9c6ea6e2044 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:59.107395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 393/782] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:59.114216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e69ad-3e8d-4d59-b05c-c42924a99189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ee8e69ad-3e8d-4d59-b05c-c42924a99189 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:59.122436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:59.124002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:59.125263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 390/783] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:59.131865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239e4f9-f99e-413d-a51f-d9c6ea6e2044 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.158795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.296178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239e4f9-f99e-413d-a51f-d9c6ea6e2044 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.337360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.338048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.338345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.338629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.339469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:59.339783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:59.341171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:59.350456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 394/784] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:59.355967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e69ad-3e8d-4d59-b05c-c42924a99189 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.383244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.483209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e69ad-3e8d-4d59-b05c-c42924a99189 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.523586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95126bff-4672-40bc-a234-15d6dc485c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.524716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126bff-4672-40bc-a234-15d6dc485c5e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.525198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126bff-4672-40bc-a234-15d6dc485c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.525654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126bff-4672-40bc-a234-15d6dc485c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.536573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126bff-4672-40bc-a234-15d6dc485c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:59.538297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126bff-4672-40bc-a234-15d6dc485c5e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-95126bff-4672-40bc-a234-15d6dc485c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:59.556467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:59.557380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:59.558260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:59.558260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:59.558260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:59.558260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:20:59.560242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 391/785] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:59.567840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.630546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c5829-c138-4509-9060-904186ae367e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.631088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c5829-c138-4509-9060-904186ae367e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.631540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c5829-c138-4509-9060-904186ae367e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.633039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 392/786] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:59.639446 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298050e-6e44-41a8-a801-b4b0829652c3 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.639910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298050e-6e44-41a8-a801-b4b0829652c3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.640336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298050e-6e44-41a8-a801-b4b0829652c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.667974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1298050e-6e44-41a8-a801-b4b0829652c3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:59.669302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1298050e-6e44-41a8-a801-b4b0829652c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:59.685008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.705830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f06f-b282-4bb1-bafb-948644d41c26 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.742890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.743517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.743808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.744091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.744843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:59.745225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:59.746736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:59.760793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 395/787] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:59.766040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.782631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.790589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 393/788] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:20:59.832191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298050e-6e44-41a8-a801-b4b0829652c3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.915322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c606f-ffe1-4e57-82d9-7f927647f3a3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.951027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.951885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.952175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.952456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.954336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.960194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:59.962412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:20:59.978130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:59.979315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:20:59.980376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:20:59.983003 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 396/789] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:59.994794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.028668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298050e-6e44-41a8-a801-b4b0829652c3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.095686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50206b1-a0b1-4b56-b79f-0b9b3aeac89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.096484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50206b1-a0b1-4b56-b79f-0b9b3aeac89d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.096765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50206b1-a0b1-4b56-b79f-0b9b3aeac89d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.097041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50206b1-a0b1-4b56-b79f-0b9b3aeac89d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.118446 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50206b1-a0b1-4b56-b79f-0b9b3aeac89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b50206b1-a0b1-4b56-b79f-0b9b3aeac89d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:00.126050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:00.127041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:00.127872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:00.129606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 394/790] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:00.139119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50206b1-a0b1-4b56-b79f-0b9b3aeac89d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.186597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60caa4-341a-460e-a1b6-9532e6a50a15 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.211453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.259781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50206b1-a0b1-4b56-b79f-0b9b3aeac89d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.293821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.294923 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.295357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.295854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.296171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.296842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.297128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.297372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:00.297817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.298144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:00.298428 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.298538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.299838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.300278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.309021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 395/791] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:00.314736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.335156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 397/792] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:00.339371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.436943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.515283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051c0f-12e6-4e3f-976f-71e98a3d6bd8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.532730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783c7c0-23b7-4b4a-a7f9-3eb4ff2dc015 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.556648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.586013 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.586832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.587120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.587398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.590360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.591188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.591471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.592501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.610619 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.612130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.615125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.616589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:00.640852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:00.641830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:00.642715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:00.642715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:00.642715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:00.642715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:00.643401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:00.644212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:00.645570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:00.645570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:00.645570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:00.645570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:00.645570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 398/793] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:00.651193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 396/794] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:00.651454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.657919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.774268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050a3aa-506d-4ddf-8f9d-da1624d02ebb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.813390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50dfc-f1b1-49b0-b331-fca1dfeb7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.814064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50dfc-f1b1-49b0-b331-fca1dfeb7f46 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.814347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50dfc-f1b1-49b0-b331-fca1dfeb7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.814756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50dfc-f1b1-49b0-b331-fca1dfeb7f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.815574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc50dfc-f1b1-49b0-b331-fca1dfeb7f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:00.815885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc50dfc-f1b1-49b0-b331-fca1dfeb7f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.817262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc50dfc-f1b1-49b0-b331-fca1dfeb7f46 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.827464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc24ad-f0f6-49b9-ad1d-223be4411f72 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.830826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.831559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 397/795] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:00.833208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1159e-ebb1-4c88-8f86-928d6a053ee5 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.833702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1159e-ebb1-4c88-8f86-928d6a053ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.834162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1159e-ebb1-4c88-8f86-928d6a053ee5 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.835836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 398/796] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:00.842159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a040c2-98a2-49e9-92a6-ea3f2db84ff6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.842560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a040c2-98a2-49e9-92a6-ea3f2db84ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.842967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a040c2-98a2-49e9-92a6-ea3f2db84ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.860511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-77a040c2-98a2-49e9-92a6-ea3f2db84ff6 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:00.862051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-77a040c2-98a2-49e9-92a6-ea3f2db84ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:00.875605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.876345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.876884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.877173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.878372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:00.878687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.880771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.891021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.898620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 399/797] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:00.903281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.958960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 399/798] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:00.960700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a040c2-98a2-49e9-92a6-ea3f2db84ff6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.031521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e9b96-7d91-4242-84f4-ccdaf7dcda2c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.071058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.071874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.072163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.072955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.092646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a040c2-98a2-49e9-92a6-ea3f2db84ff6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.134030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.135296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.135793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.136295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.145012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.146992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:01.163526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:01.164469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:01.165381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:01.165381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:01.165381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:01.165381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:01.165381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:01.165381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:01.165381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:01.165381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:01.168216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 400/799] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:01.169349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.198510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.202729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.204193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:01.219111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:01.220084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:01.220972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:01.225240 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 400/800] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:01.226102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.254867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.289313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985a4c0-8cab-4c7f-8984-0f871f7a4907 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.325947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecba82-41a5-4e1d-bb3f-b02219a6d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.326761 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecba82-41a5-4e1d-bb3f-b02219a6d59a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.327074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecba82-41a5-4e1d-bb3f-b02219a6d59a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.327354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecba82-41a5-4e1d-bb3f-b02219a6d59a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.333000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd9b5c-fed1-48f8-82c1-94ace17fd6e8 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.337498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecba82-41a5-4e1d-bb3f-b02219a6d59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-27ecba82-41a5-4e1d-bb3f-b02219a6d59a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:01.345745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:01.346887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:01.347901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:01.351990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 401/801] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:01.352820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecba82-41a5-4e1d-bb3f-b02219a6d59a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.374106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e1656-4890-4549-bc8d-24fad7186478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.375136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e1656-4890-4549-bc8d-24fad7186478 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.375593 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e1656-4890-4549-bc8d-24fad7186478 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.376014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e1656-4890-4549-bc8d-24fad7186478 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.377050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e1656-4890-4549-bc8d-24fad7186478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:01.377507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e1656-4890-4549-bc8d-24fad7186478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.379184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e1656-4890-4549-bc8d-24fad7186478 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.397300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 401/802] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:01.398938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbcd8-0f35-4fbb-9308-f2a0b9c21312 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.399378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbcd8-0f35-4fbb-9308-f2a0b9c21312 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.399800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbcd8-0f35-4fbb-9308-f2a0b9c21312 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.401362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 402/803] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:01.402207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dbcd8-0f35-4fbb-9308-f2a0b9c21312 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.437853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.458704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecba82-41a5-4e1d-bb3f-b02219a6d59a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.493279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.493955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.494240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.494515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.495205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.495395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:01.495692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.497369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.514331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dbcd8-0f35-4fbb-9308-f2a0b9c21312 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.514935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 402/804] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:01.515721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.554411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42385e-6d04-4e32-bbfb-ae5c1f89d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.555131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42385e-6d04-4e32-bbfb-ae5c1f89d824 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.555411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42385e-6d04-4e32-bbfb-ae5c1f89d824 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.555691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42385e-6d04-4e32-bbfb-ae5c1f89d824 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.556439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42385e-6d04-4e32-bbfb-ae5c1f89d824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:01.556748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42385e-6d04-4e32-bbfb-ae5c1f89d824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.558121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42385e-6d04-4e32-bbfb-ae5c1f89d824 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.566675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 403/805] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:01.567780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314d93-62c4-4c3e-942d-70d297a677a3 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.568072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314d93-62c4-4c3e-942d-70d297a677a3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.568352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314d93-62c4-4c3e-942d-70d297a677a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.586056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-62314d93-62c4-4c3e-942d-70d297a677a3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:01.587397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-62314d93-62c4-4c3e-942d-70d297a677a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:01.629780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d223e4-9491-457b-ab83-125d4a211753 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.656340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 404/806] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:01.657198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62314d93-62c4-4c3e-942d-70d297a677a3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.670378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d2943-7305-4407-a950-b8d843720648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.671355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d2943-7305-4407-a950-b8d843720648 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.671617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d2943-7305-4407-a950-b8d843720648 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.671893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d2943-7305-4407-a950-b8d843720648 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/6c7f048f7f1c4df1a9f6dca0fc4ce75a/roles/b7366b7493b54614bff185596a63f32f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.684396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.688845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d2943-7305-4407-a950-b8d843720648 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=6c7f048f7f1c4df1a9f6dca0fc4ce75a, role_id=b7366b7493b54614bff185596a63f32f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.690437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d2943-7305-4407-a950-b8d843720648 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.702215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 403/807] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:01 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/6c7f048f7f1c4df1a9f6dca0fc4ce75a/roles/b7366b7493b54614bff185596a63f32f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:01.703201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d2943-7305-4407-a950-b8d843720648 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.740431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.769900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62314d93-62c4-4c3e-942d-70d297a677a3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.809161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338db11c-f48b-4823-bf9e-50f105eb0e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.809880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338db11c-f48b-4823-bf9e-50f105eb0e22 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.810193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338db11c-f48b-4823-bf9e-50f105eb0e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.810504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338db11c-f48b-4823-bf9e-50f105eb0e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.812651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d2943-7305-4407-a950-b8d843720648 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.822068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338db11c-f48b-4823-bf9e-50f105eb0e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.823650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338db11c-f48b-4823-bf9e-50f105eb0e22 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-338db11c-f48b-4823-bf9e-50f105eb0e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:01.844947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:01.845919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:01.847350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:01.847350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:01.847350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:01.847350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:01.847350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 405/808] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:01.847659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce0028-e4c5-46d9-87e0-26a506361c6b None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.847984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce0028-e4c5-46d9-87e0-26a506361c6b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.848085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce0028-e4c5-46d9-87e0-26a506361c6b None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.853938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 406/809] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:01.853938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce0028-e4c5-46d9-87e0-26a506361c6b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.861457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.862281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.862574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.862890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.873968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.875481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:01.894937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:01.895892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:01.896843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:01.896843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:01.896843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:01.896843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:01.896843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 404/810] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:01.897967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.943506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.967983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce0028-e4c5-46d9-87e0-26a506361c6b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.995655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.004413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e0c2-512e-4422-b5fc-38e87ecd87ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.005231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e0c2-512e-4422-b5fc-38e87ecd87ac None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.005540 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e0c2-512e-4422-b5fc-38e87ecd87ac None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.005787 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e0c2-512e-4422-b5fc-38e87ecd87ac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.006470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8e0c2-512e-4422-b5fc-38e87ecd87ac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.007848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8e0c2-512e-4422-b5fc-38e87ecd87ac None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.008922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b32f-9f7f-460a-bf4e-177f279ca4b2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-04e8e0c2-512e-4422-b5fc-38e87ecd87ac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:02.020219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:02.021150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:02.021974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 407/811] 10.222.0.72 () {56 vars in 1129 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:02.023223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385e26-5a62-4877-9069-c4a48fe71e35 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.023223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385e26-5a62-4877-9069-c4a48fe71e35 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.023223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385e26-5a62-4877-9069-c4a48fe71e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.040137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-52385e26-5a62-4877-9069-c4a48fe71e35 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:02.041367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-52385e26-5a62-4877-9069-c4a48fe71e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:02.056133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.057088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.057669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.058150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.059633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.059891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.061317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.078742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 405/812] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.078742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.123500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 408/813] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:02.124639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52385e26-5a62-4877-9069-c4a48fe71e35 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.193927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14be7a-7751-47ab-843d-760eec52340c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.195914 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.233677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.234344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.234632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.234940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.235658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.236054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.237323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.238087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52385e26-5a62-4877-9069-c4a48fe71e35 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.249252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 406/814] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.254541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.262022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.275936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.276615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.276901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.277181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.278580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.279430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.280815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.289571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 409/815] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.289571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.368670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178530ff-34ec-44c8-a2f6-a5a070177eda None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.394104 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1c93-c45f-4e4c-8ce6-04f170b3ab10 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.403117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.404702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.404985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.405258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.412393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.413836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.430619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:02.430820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:02.431660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:02.432517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 407/816] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:02.432997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.434115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.434612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.435053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.435936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.437815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:02.450204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:02.451305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:02.452134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 410/817] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:02.453016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.470460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.516445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.556885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca6c6c-06c4-4470-8ff6-960b577f2e7a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.568280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b3c70-0669-49d2-ac08-6c4e7c18ebe9 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.594023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.595105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.595516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.595800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.603460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.604298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.604901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.605001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.605273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.605517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.606224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.606536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.607957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.617207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 411/818] 10.222.0.72 () {56 vars in 1124 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.617207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:02.619867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:02.620824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:02.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 408/819] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:02.622317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.718477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.728394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda1a45-1819-4f14-8ebf-557e7d5c4bc7 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.744075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.744855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdb07b-828e-434b-8d1c-c20412f38e97 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.767883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.768563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.768853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.769131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.769925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.770246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.771730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.782121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.783288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.783789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.784253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.784643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 412/820] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.785345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] RBAC: Adding query filter params (name=network) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.785453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.785941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.787374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.798141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 409/821] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.799070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.899447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ccc60-0d58-4e33-83ce-ecdb8810ad4e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.910248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07534dc0-7d3a-4ba3-b7e2-2a42227adf50 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.937941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a399-5637-4a33-863a-a5eea2eed60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.938613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a399-5637-4a33-863a-a5eea2eed60b None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.938936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a399-5637-4a33-863a-a5eea2eed60b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.939217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097a399-5637-4a33-863a-a5eea2eed60b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.939956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097a399-5637-4a33-863a-a5eea2eed60b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.941332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097a399-5637-4a33-863a-a5eea2eed60b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.944499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.945269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.945556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.945841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.946668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.947010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.948444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.963261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 413/822] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:21:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:02.963750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a399-5637-4a33-863a-a5eea2eed60b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.978296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 410/823] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.978296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.985812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.031675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.114089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba80f72-e25d-4dd0-aa67-64494fc0172d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.129519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097a399-5637-4a33-863a-a5eea2eed60b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.156077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.157107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.157398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.158701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.158701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] RBAC: Adding query filter params (type=network) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:03.159010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.160169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.172850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 411/824] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:03.172850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.176176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c54dd0-85f6-4e44-ba6f-d69a3ccbac5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.177222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c54dd0-85f6-4e44-ba6f-d69a3ccbac5a None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.177512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c54dd0-85f6-4e44-ba6f-d69a3ccbac5a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.177791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c54dd0-85f6-4e44-ba6f-d69a3ccbac5a None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/9422f3bea364469093eb4046b011017e/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.179815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c54dd0-85f6-4e44-ba6f-d69a3ccbac5a None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=9422f3bea364469093eb4046b011017e, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.181779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c54dd0-85f6-4e44-ba6f-d69a3ccbac5a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.202085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 414/825] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:02 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/9422f3bea364469093eb4046b011017e/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:03.203559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c54dd0-85f6-4e44-ba6f-d69a3ccbac5a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.266078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.323191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.345698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c61007-cd33-4275-aa5c-26c8ead30771 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.356790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c54dd0-85f6-4e44-ba6f-d69a3ccbac5a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.408855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f4dc2-9c18-440f-a3fd-c308e2409aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.409445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f4dc2-9c18-440f-a3fd-c308e2409aef None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.409731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f4dc2-9c18-440f-a3fd-c308e2409aef None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.410010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f4dc2-9c18-440f-a3fd-c308e2409aef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.416629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad626dc4-d8ab-4d95-8b5e-808b2e8ef7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.417298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626dc4-d8ab-4d95-8b5e-808b2e8ef7d3 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.417583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626dc4-d8ab-4d95-8b5e-808b2e8ef7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.417856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626dc4-d8ab-4d95-8b5e-808b2e8ef7d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.418592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad626dc4-d8ab-4d95-8b5e-808b2e8ef7d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.420145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad626dc4-d8ab-4d95-8b5e-808b2e8ef7d3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.443258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 415/826] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:21:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:03.494505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f4dc2-9c18-440f-a3fd-c308e2409aef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.495998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f4dc2-9c18-440f-a3fd-c308e2409aef None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.571799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.611134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 412/827] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:03.616655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad626dc4-d8ab-4d95-8b5e-808b2e8ef7d3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.756180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad626dc4-d8ab-4d95-8b5e-808b2e8ef7d3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.795773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406f03-8fe7-426c-9146-1c29d002a3ae None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.796072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406f03-8fe7-426c-9146-1c29d002a3ae None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.796360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406f03-8fe7-426c-9146-1c29d002a3ae None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.797587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.797960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 413/828] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:03.798829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.799283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.799737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.802999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ace7fa-0ccb-4c5c-bd96-7a09b5cf3a8e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.803293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ace7fa-0ccb-4c5c-bd96-7a09b5cf3a8e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.803578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ace7fa-0ccb-4c5c-bd96-7a09b5cf3a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.808558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.815601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.817869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.824247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-18ace7fa-0ccb-4c5c-bd96-7a09b5cf3a8e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:03.825464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-18ace7fa-0ccb-4c5c-bd96-7a09b5cf3a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:03.845906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:03.846884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:03.847783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:03.847783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:03.847783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:03.847783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:03.848723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 416/829] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:03.854432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.920953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 414/830] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:03.944234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ace7fa-0ccb-4c5c-bd96-7a09b5cf3a8e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.989463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba066f3b-14c2-4cef-8e47-46862280e329 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.035474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.036468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.036975 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.037462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.038872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:04.039508 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.041431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.049991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.054240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ace7fa-0ccb-4c5c-bd96-7a09b5cf3a8e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.074531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 417/831] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:04.080213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.093752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54840d-3e65-4913-82b8-9cf27f9380cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.094988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54840d-3e65-4913-82b8-9cf27f9380cc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.095384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54840d-3e65-4913-82b8-9cf27f9380cc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.095775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54840d-3e65-4913-82b8-9cf27f9380cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.107619 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54840d-3e65-4913-82b8-9cf27f9380cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ef54840d-3e65-4913-82b8-9cf27f9380cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:04.116211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:04.117314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:04.118134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:04.123786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 415/832] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:04.124877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54840d-3e65-4913-82b8-9cf27f9380cc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.143284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.214361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a7fb6-80eb-4b9a-b0a2-ce02f16661e8 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.245544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54840d-3e65-4913-82b8-9cf27f9380cc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.252629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.253422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.253704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.253978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.260748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.262207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:04.276142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:04.277032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:04.277903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:04.277903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:04.277903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:04.277903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:04.277903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:04.277903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:04.277903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:04.277903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:04.282226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 418/833] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:04.283100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.287325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.288365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.288904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.289379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.290367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:04.290896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.292529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.302299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 416/834] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:04.307894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.338163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.395685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be983379-c0cd-4af5-8ddd-040bdd5561eb None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.423192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.435445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.436228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.436576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.436935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.437805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:04.438323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.439893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.445669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00be7f6-4e8e-4431-b758-48ac8d0145bc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.457473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 419/835] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:04.458443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.484672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.485877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.485989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.486261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.497980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.499565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:04.518385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:04.519297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:04.520157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:04.520157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:04.520157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:04.520157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:04.524486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 417/836] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:04.525495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.583177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d7a5a-e0f9-4156-aa2e-bccb56ebd6bb None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.603360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.631269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.632183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.632478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.632759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.633858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=7926b212faa44c228ff4ad9e63ee0287) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:04.634581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.636607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.640543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ce72b-e953-492d-ad42-9988440a4d52 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.645028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 420/837] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/role_assignments?user.id=7926b212faa44c228ff4ad9e63ee0287&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:04.689719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.690707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.691160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.691616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.692500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:04.692962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.694590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.709191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 418/838] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:04.717701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.768422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.840872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7396f-fb62-47a8-8aff-320466583950 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.877429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.878335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.878564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.878891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.886521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.888565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:04.904749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:04.905963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:04.907328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 421/839] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:04.911876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.023217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becee07-6ce8-4346-a40f-f635bd351708 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.066744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.072778 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d98f5-67b4-4555-9722-84215ae1d4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.073477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d98f5-67b4-4555-9722-84215ae1d4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.073769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d98f5-67b4-4555-9722-84215ae1d4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.074056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d98f5-67b4-4555-9722-84215ae1d4c8 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.074948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d98f5-67b4-4555-9722-84215ae1d4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:05.075264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d98f5-67b4-4555-9722-84215ae1d4c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.077338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d98f5-67b4-4555-9722-84215ae1d4c8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.104874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 419/840] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:05.112773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.216737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.224504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b7071-2768-4be5-a1c7-0cdfa4b14345 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.260015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8f15b-0e66-49f4-b086-2131af5546c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.260548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f15b-0e66-49f4-b086-2131af5546c1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.260842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f15b-0e66-49f4-b086-2131af5546c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.261125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f15b-0e66-49f4-b086-2131af5546c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.332506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8f15b-0e66-49f4-b086-2131af5546c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.334136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8f15b-0e66-49f4-b086-2131af5546c1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.341358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314603f-bc22-4666-90e5-d3ba79f9d189 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.341972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314603f-bc22-4666-90e5-d3ba79f9d189 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.342458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314603f-bc22-4666-90e5-d3ba79f9d189 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.344332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 420/841] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:05.349578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c481c-326c-47c4-83e3-c24db41bc135 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.350123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c481c-326c-47c4-83e3-c24db41bc135 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.350601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c481c-326c-47c4-83e3-c24db41bc135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.368142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1e6c481c-326c-47c4-83e3-c24db41bc135 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:05.369797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1e6c481c-326c-47c4-83e3-c24db41bc135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:05.440735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.450340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 422/842] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:05.452323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 421/843] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:05.455321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8f15b-0e66-49f4-b086-2131af5546c1 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.470497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c481c-326c-47c4-83e3-c24db41bc135 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.559804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8f15b-0e66-49f4-b086-2131af5546c1 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.579903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c481c-326c-47c4-83e3-c24db41bc135 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.595764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90ed00-ad6b-460f-8daf-77a4ed9e08cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.596826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90ed00-ad6b-460f-8daf-77a4ed9e08cd None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.597292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90ed00-ad6b-460f-8daf-77a4ed9e08cd None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.597788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90ed00-ad6b-460f-8daf-77a4ed9e08cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.601189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.608769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90ed00-ad6b-460f-8daf-77a4ed9e08cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.610219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90ed00-ad6b-460f-8daf-77a4ed9e08cd None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.617604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.618465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.618707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.619262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.619965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.621324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-7e90ed00-ad6b-460f-8daf-77a4ed9e08cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:05.629436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:05.630272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:05.631187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:05.631187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:05.631187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:05.631187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:05.640814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 423/844] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:05.640973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:05.641869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:05.642681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:05.643433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d7f24-869d-48b8-adc2-97f0478eb542 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.643433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d7f24-869d-48b8-adc2-97f0478eb542 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.643433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d7f24-869d-48b8-adc2-97f0478eb542 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.643623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 422/845] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:05.643699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 424/846] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:05.643771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.643838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b31a13-23ad-4fe8-9d8b-58efc3a71a24 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.643838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b31a13-23ad-4fe8-9d8b-58efc3a71a24 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.643838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b31a13-23ad-4fe8-9d8b-58efc3a71a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.661329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-26b31a13-23ad-4fe8-9d8b-58efc3a71a24 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:05.662857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-26b31a13-23ad-4fe8-9d8b-58efc3a71a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:05.714877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.742391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 425/847] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:05.743360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b31a13-23ad-4fe8-9d8b-58efc3a71a24 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.745896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c4484-4d12-4a71-ab59-a576abaf4621 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.790607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.791451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.791723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.792008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.792752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:05.793050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.794978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.812234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 423/848] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:05.812234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.854558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b31a13-23ad-4fe8-9d8b-58efc3a71a24 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.860081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.892004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.892610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.892896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.893184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.893893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:05.894204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.896312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.903145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 426/849] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:05.904450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.924990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad454e8-6a80-432a-85b6-5fddcf15999f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.950683 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.968956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd2b1f-16a7-4047-aa8e-89bf40342eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.969879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2b1f-16a7-4047-aa8e-89bf40342eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.970065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2b1f-16a7-4047-aa8e-89bf40342eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.970340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2b1f-16a7-4047-aa8e-89bf40342eb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.982891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd2b1f-16a7-4047-aa8e-89bf40342eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c1cd2b1f-16a7-4047-aa8e-89bf40342eb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:05.991738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:05.992669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:05.993475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 424/850] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:05.995044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd2b1f-16a7-4047-aa8e-89bf40342eb2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.019445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3564-61c0-4fbd-8f01-6d4aed7c3b9c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.067649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.068466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.068756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.069039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.077146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.078608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:06.093076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:06.094027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:06.094958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:06.094958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:06.094958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:06.094958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:06.094958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:06.094958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:06.094958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:06.094958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:06.099011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 427/851] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:06.099136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd2b1f-16a7-4047-aa8e-89bf40342eb2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.099769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.102466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:06.136690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.137361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.137652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.137963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.138677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:06.139057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.140428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.145028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 425/852] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:06.145752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.217883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:06.222745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada41e-201e-407e-a0ae-e9159726680c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.270918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.271566 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad8c2a-ab89-4f43-8917-5d64dbe152b7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.271813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.272175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.272531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.273382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:06.273774 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.276665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.289112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 428/853] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:06.294343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.323375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.324378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.324847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.325976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.327043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:06.327645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.329312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.346888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 426/854] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:06.349715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.385661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:06.417200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c50d0-8367-475e-b030-64f1e90c20a2 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.455208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.457166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.457615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.458090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.470603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.472494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.475798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18ccc-3e41-4c99-a7fb-cb49764a7c8d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:06.491310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:06.492269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:06.493170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:06.493170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:06.493170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:06.493170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:06.495586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 429/855] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:06.506794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.513752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.514894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.515184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.515462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.516680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=6c7f048f7f1c4df1a9f6dca0fc4ce75a) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:06.517001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.519057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.521356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:06.530852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 427/856] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/role_assignments?user.id=6c7f048f7f1c4df1a9f6dca0fc4ce75a&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:06.623094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9cae-a86d-4319-b4c9-1ea3a296ed98 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.661585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.662548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.663011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.663436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.664349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:06.664809 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.666383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.680065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 430/857] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:06.686338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.786136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:06.796127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bba97a-09e7-40cf-8a1f-c40d3cb23278 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.832289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe7f5a-b439-4d60-b406-4e06d71c0993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.833112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7f5a-b439-4d60-b406-4e06d71c0993 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.833403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7f5a-b439-4d60-b406-4e06d71c0993 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.833687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7f5a-b439-4d60-b406-4e06d71c0993 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.841961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe7f5a-b439-4d60-b406-4e06d71c0993 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.843453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe7f5a-b439-4d60-b406-4e06d71c0993 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2dfe7f5a-b439-4d60-b406-4e06d71c0993 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:06.858259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:06.859314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:06.860631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 428/858] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:06.865348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.892027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043fd67-ec19-458d-9b78-70cfd6372626 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.892319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043fd67-ec19-458d-9b78-70cfd6372626 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.892614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043fd67-ec19-458d-9b78-70cfd6372626 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.894241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 429/859] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:06.899100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa17c5-adc9-4e05-9048-3e2d55398755 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.899400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa17c5-adc9-4e05-9048-3e2d55398755 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.899687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa17c5-adc9-4e05-9048-3e2d55398755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.916879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1daa17c5-adc9-4e05-9048-3e2d55398755 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:06.918084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1daa17c5-adc9-4e05-9048-3e2d55398755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:06.955357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:06.989125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c31840-ec12-4caf-90c2-f118e2bf0ff9 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.991517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 430/860] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:07.016088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa17c5-adc9-4e05-9048-3e2d55398755 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.026050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.026746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.027064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.027346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.029568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:07.030043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.031949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.052777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 431/861] 10.222.0.72 () {56 vars in 1135 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:07.059757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.125337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.147117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa17c5-adc9-4e05-9048-3e2d55398755 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.188006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.189206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.189702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.190196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.191115 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.192731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.193875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dfb05-5e5f-492e-af21-ad169c1cb95f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:07.207299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:07.208311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:07.209148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:07.217217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 431/862] 10.222.0.72 () {56 vars in 1132 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:07.218297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.231912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.239878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf4fc2-899e-40b7-8bf4-88f903af187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.240577 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf4fc2-899e-40b7-8bf4-88f903af187a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.241265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf4fc2-899e-40b7-8bf4-88f903af187a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.241557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf4fc2-899e-40b7-8bf4-88f903af187a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.318820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf4fc2-899e-40b7-8bf4-88f903af187a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.320873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf4fc2-899e-40b7-8bf4-88f903af187a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.336303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7e698-cd3b-428e-bf92-10ce080e5603 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.373287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.374061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.374348 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.374627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.375413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:07.375915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.377120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.386323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 432/863] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:07.387401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.405063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.446486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 432/864] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:07.452081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf4fc2-899e-40b7-8bf4-88f903af187a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.487722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.512564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5103c-41dc-4357-8f32-e2131e952759 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.548770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.549765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.550254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.550738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.551782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:07.552337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.553897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.566811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf4fc2-899e-40b7-8bf4-88f903af187a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.567638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 433/865] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:07.600666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.601490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.601779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.602059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.614035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.615573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:07.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:07.638234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:07.639544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:07.639544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:07.639544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:07.639544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:07.642891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 433/866] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:07.644664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.729574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.762753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea20be-df55-4ac1-807c-c95794cdbb19 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.798749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.799456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.799742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.800018 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.800901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:07.801216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.802590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.816644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 434/867] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:07.822197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.910515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.927208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4a001-8da1-49ea-a42f-5a14a07178ba None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.963232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.964044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.964336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.964618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.972217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.973134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:07.987617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:07.988478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:07.989326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:07.989326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:07.989326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:07.989326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:07.989326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:07.989326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:07.989326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:07.989326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:07.993470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 434/868] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:07.994922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:08.104540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef052e-d663-49f1-822c-30aeecbe39ae None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:08.140367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121003a-311d-49b9-9858-abfc3f19d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:08.141476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121003a-311d-49b9-9858-abfc3f19d45c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.141982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121003a-311d-49b9-9858-abfc3f19d45c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.142461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121003a-311d-49b9-9858-abfc3f19d45c None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.143493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121003a-311d-49b9-9858-abfc3f19d45c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:08.144021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121003a-311d-49b9-9858-abfc3f19d45c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:08.145647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121003a-311d-49b9-9858-abfc3f19d45c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:08.147475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:08.159730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 435/869] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:08.168294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:08.269140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83702b1-fb92-4e4d-8202-c5bd23a15fad None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:08.282669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca0d3e-6dd1-436b-a1ac-82f98be9f8af None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.282997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca0d3e-6dd1-436b-a1ac-82f98be9f8af None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.283282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca0d3e-6dd1-436b-a1ac-82f98be9f8af None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.284896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 436/870] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:08.289620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ba03a-0b54-4802-9d2e-e2adb038e557 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.289916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ba03a-0b54-4802-9d2e-e2adb038e557 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.290194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ba03a-0b54-4802-9d2e-e2adb038e557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.307684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:08.308193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-532ba03a-0b54-4802-9d2e-e2adb038e557 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:08.308327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.308620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.308898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.309436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-532ba03a-0b54-4802-9d2e-e2adb038e557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:08.309775 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=9422f3bea364469093eb4046b011017e) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:08.310088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:08.311683 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:08.318456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 435/871] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:08 2022] GET /identity/v3/role_assignments?user.id=9422f3bea364469093eb4046b011017e&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:08.394279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 437/872] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:08.417654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:08.430674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:08.526675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8059a-8089-4d0f-82d4-f368be1e70f0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:08.561668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ba2ac-45f1-485e-a841-2bc32cac7bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:08.562347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba2ac-45f1-485e-a841-2bc32cac7bd2 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.562628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba2ac-45f1-485e-a841-2bc32cac7bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.562947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba2ac-45f1-485e-a841-2bc32cac7bd2 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.563672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ba2ac-45f1-485e-a841-2bc32cac7bd2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:08.565047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ba2ac-45f1-485e-a841-2bc32cac7bd2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:08.582623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 436/873] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:21:08 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:08.805680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d265f-caa6-4384-b09e-f068b18b9e90 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.806291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d265f-caa6-4384-b09e-f068b18b9e90 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.806291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d265f-caa6-4384-b09e-f068b18b9e90 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.807906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 438/874] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:08.813323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a53f24-0e16-496d-a750-cb66f7ae4a4d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.813631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a53f24-0e16-496d-a750-cb66f7ae4a4d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.813927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a53f24-0e16-496d-a750-cb66f7ae4a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.831912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-19a53f24-0e16-496d-a750-cb66f7ae4a4d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:08.833230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-19a53f24-0e16-496d-a750-cb66f7ae4a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:08.899151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:08.911871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 437/875] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:08.935513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d265f-caa6-4384-b09e-f068b18b9e90 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.045063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d265f-caa6-4384-b09e-f068b18b9e90 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.071088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.082325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6bd8b-eb1a-4bee-b1ef-5489f3bd8701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.083179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6bd8b-eb1a-4bee-b1ef-5489f3bd8701 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.083521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6bd8b-eb1a-4bee-b1ef-5489f3bd8701 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.083752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6bd8b-eb1a-4bee-b1ef-5489f3bd8701 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.094196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6bd8b-eb1a-4bee-b1ef-5489f3bd8701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-09e6bd8b-eb1a-4bee-b1ef-5489f3bd8701 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:09.102391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:09.103367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:09.104442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 439/876] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jul 12 14:21:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:09.109792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a53f24-0e16-496d-a750-cb66f7ae4a4d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.213031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a53f24-0e16-496d-a750-cb66f7ae4a4d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.251832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.252819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.253319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.253780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.254713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:09.255233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:09.256795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:09.265654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 438/877] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jul 12 14:21:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:09.274870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6bd8b-eb1a-4bee-b1ef-5489f3bd8701 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.374876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6bd8b-eb1a-4bee-b1ef-5489f3bd8701 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.409800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60250201-632e-471e-91f0-1236880a8caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.410606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60250201-632e-471e-91f0-1236880a8caa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.410924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60250201-632e-471e-91f0-1236880a8caa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.411209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60250201-632e-471e-91f0-1236880a8caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.426566 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60250201-632e-471e-91f0-1236880a8caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:09.428050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60250201-632e-471e-91f0-1236880a8caa None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-60250201-632e-471e-91f0-1236880a8caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:09.446281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:09.447244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:09.448333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:09.448333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:09.448333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:09.448333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:09.448333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 440/878] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:09.454929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.523269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.585544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c88d-3864-4ebb-9bb6-1c8141aa29c3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.622060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90cedd-cd47-41f4-a7dd-60952cc0eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.622748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90cedd-cd47-41f4-a7dd-60952cc0eb66 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.623070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90cedd-cd47-41f4-a7dd-60952cc0eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.623355 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90cedd-cd47-41f4-a7dd-60952cc0eb66 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.624092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90cedd-cd47-41f4-a7dd-60952cc0eb66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:09.624406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90cedd-cd47-41f4-a7dd-60952cc0eb66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:09.625915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90cedd-cd47-41f4-a7dd-60952cc0eb66 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:09.638625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 439/879] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:09.644511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60250201-632e-471e-91f0-1236880a8caa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.662894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45946-9101-462a-9f17-04a12cb55651 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.663198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45946-9101-462a-9f17-04a12cb55651 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.663484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45946-9101-462a-9f17-04a12cb55651 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.665116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 440/880] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:09.672633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f1081-d30e-4c02-91ba-dea04bb34614 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.672926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f1081-d30e-4c02-91ba-dea04bb34614 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.673218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f1081-d30e-4c02-91ba-dea04bb34614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.684314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.691257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-439f1081-d30e-4c02-91ba-dea04bb34614 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:09.692466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-439f1081-d30e-4c02-91ba-dea04bb34614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:09.755833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60250201-632e-471e-91f0-1236880a8caa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.774906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 441/881] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:09.791315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.792133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.792503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.792784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.793390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f1081-d30e-4c02-91ba-dea04bb34614 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.800938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:09.802385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:09.817487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:09.818889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:09.819838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 441/882] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:21:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:09.829143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.847840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.921125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f1081-d30e-4c02-91ba-dea04bb34614 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.967591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172b2fd-c485-4bb9-96f3-f068c1151e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.968869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b2fd-c485-4bb9-96f3-f068c1151e04 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.969360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b2fd-c485-4bb9-96f3-f068c1151e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.969949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172b2fd-c485-4bb9-96f3-f068c1151e04 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.970577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.971122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172b2fd-c485-4bb9-96f3-f068c1151e04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:09.973357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172b2fd-c485-4bb9-96f3-f068c1151e04 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:09.979398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c12ec-9754-4169-b638-9bd9fab2f369 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.999264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 442/883] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:21:09 2022] POST /identity/v3/services => generated 269 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:10.033882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.034635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.034967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.035301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.036207 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:10.036527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.037997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.066704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 442/884] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jul 12 14:21:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:10.071793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172b2fd-c485-4bb9-96f3-f068c1151e04 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.187152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172b2fd-c485-4bb9-96f3-f068c1151e04 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.194833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.230202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241c4fc-46ab-4a9a-9fad-2a4ec9204b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.230918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c4fc-46ab-4a9a-9fad-2a4ec9204b85 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.231250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c4fc-46ab-4a9a-9fad-2a4ec9204b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.231532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c4fc-46ab-4a9a-9fad-2a4ec9204b85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.301432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241c4fc-46ab-4a9a-9fad-2a4ec9204b85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.302938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241c4fc-46ab-4a9a-9fad-2a4ec9204b85 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.405962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 443/885] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:10.411655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.519354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799d68a-7ca4-4bd3-a81a-7321fb4640ed None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.530699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5fad9-6374-4eef-8d1d-d6ef71615fd4 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.531030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5fad9-6374-4eef-8d1d-d6ef71615fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.531363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5fad9-6374-4eef-8d1d-d6ef71615fd4 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.533044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 444/886] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:10.539922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4a790-c46a-4910-91fc-1a1a01140e9a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.539922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4a790-c46a-4910-91fc-1a1a01140e9a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.539922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4a790-c46a-4910-91fc-1a1a01140e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.555145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.557460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-2be4a790-c46a-4910-91fc-1a1a01140e9a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:10.558981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2be4a790-c46a-4910-91fc-1a1a01140e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:10.561029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.562015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.562312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.562591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.576521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.578267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:10.602718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:10.612890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:10.613856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:10.613856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:10.613856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:10.613856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:10.613856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 443/887] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:10.613856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.619103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.635976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 445/888] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:10.659873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4a790-c46a-4910-91fc-1a1a01140e9a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.722079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9291b-0adc-4a9c-b0ae-799948e67bb8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.758290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.759040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.759336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.759616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.760351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:10.760660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.762032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.774601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 444/889] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:10.780143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.789272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4a790-c46a-4910-91fc-1a1a01140e9a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.826526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124ffa9-ffae-44b2-bd1b-fe7e9a6f7874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.827386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ffa9-ffae-44b2-bd1b-fe7e9a6f7874 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.827716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ffa9-ffae-44b2-bd1b-fe7e9a6f7874 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.828035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ffa9-ffae-44b2-bd1b-fe7e9a6f7874 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.828772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124ffa9-ffae-44b2-bd1b-fe7e9a6f7874 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.830291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124ffa9-ffae-44b2-bd1b-fe7e9a6f7874 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.833352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-7124ffa9-ffae-44b2-bd1b-fe7e9a6f7874 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:10.845989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:10.847052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:10.851874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 446/890] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:10.852674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f35cc-865b-46e8-a886-3c862b0ce4d3 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.852674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f35cc-865b-46e8-a886-3c862b0ce4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.852674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f35cc-865b-46e8-a886-3c862b0ce4d3 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.852674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 447/891] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:10.854896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f35cc-865b-46e8-a886-3c862b0ce4d3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.859749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.901901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11dfe1-a57b-465e-84e6-53e95b74f100 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.938061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc31aa-5182-459f-830c-6895228bc922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.938896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc31aa-5182-459f-830c-6895228bc922 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.939195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc31aa-5182-459f-830c-6895228bc922 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.939459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc31aa-5182-459f-830c-6895228bc922 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.947369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc31aa-5182-459f-830c-6895228bc922 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.948806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc31aa-5182-459f-830c-6895228bc922 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4afc31aa-5182-459f-830c-6895228bc922 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:10.962318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:10.963309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:10.964384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:10.964384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:10.964384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:10.964384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:10.964384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:10.964384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:10.964384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:10.964384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:10.968297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 445/892] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:10.969391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f35cc-865b-46e8-a886-3c862b0ce4d3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.969573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f02886-f2cc-4ec6-8a7a-263a6a2f7bb0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.969837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f02886-f2cc-4ec6-8a7a-263a6a2f7bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.970122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f02886-f2cc-4ec6-8a7a-263a6a2f7bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.987243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e6f02886-f2cc-4ec6-8a7a-263a6a2f7bb0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:10.988431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e6f02886-f2cc-4ec6-8a7a-263a6a2f7bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:11.006796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.007473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.007757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.008030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.008729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:11.009034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.010417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.019759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 448/893] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:11.019759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.067717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 446/894] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:11.075659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f02886-f2cc-4ec6-8a7a-263a6a2f7bb0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.087974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:11.128935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba44a1e-e9f8-4421-95a0-1bbedfdaa3de None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.135174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:11.166187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.166942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.167171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.167447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.168283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:11.169147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.170586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.182854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 449/895] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:11.183487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.190552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f02886-f2cc-4ec6-8a7a-263a6a2f7bb0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.225839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.226528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.226843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.227128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.227840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:11.228152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.229517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.234796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 447/896] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:11.235811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.312910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25480bbe-a4df-4d00-9981-039d2cd65dc3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.351197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:11.360818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482d44e-2cb3-4add-b49c-2b4108213ed0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.368183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.370100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.370608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.371238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.372697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.375124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.380135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:11.395379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:11.396424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:11.397281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:11.401165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 450/897] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:11.407650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.409589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.410274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.410584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.410935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.411887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] RBAC: Adding query filter params (role.id=ab280a3ac3d2432ca85d4f2bf884c19c, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=6c7f048f7f1c4df1a9f6dca0fc4ce75a) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:11.412288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.415229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.420626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 448/898] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:11 2022] GET /identity/v3/role_assignments?user.id=6c7f048f7f1c4df1a9f6dca0fc4ce75a&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=ab280a3ac3d2432ca85d4f2bf884c19c => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:11.526905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd53c5a-e195-4ba9-b2c6-30bc5531fefe None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.565545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.566612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.567122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.567598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.568509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:11.569036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.570635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.576864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 451/899] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:11.582155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.685677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c2b70-ebac-4341-9094-cf609e3b5c87 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.720586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.721267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.721553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.721832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.722539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:11.722871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.724233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.729589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 449/900] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:11.736091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.799485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:11.850713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b5a18-36f1-4dc2-9d8f-02e81df0c598 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.885834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b80564-e3c8-448e-91ab-1ad9b3b8ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.886514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80564-e3c8-448e-91ab-1ad9b3b8ed45 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.886820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80564-e3c8-448e-91ab-1ad9b3b8ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.887165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b80564-e3c8-448e-91ab-1ad9b3b8ed45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.888456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b80564-e3c8-448e-91ab-1ad9b3b8ed45 None admin] RBAC: Adding query filter params (interface=public, service_id=2d2f06fb4b934120bbfb3949f85c8ba0, region_id=RegionOne) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:11.888774 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b80564-e3c8-448e-91ab-1ad9b3b8ed45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.890167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b80564-e3c8-448e-91ab-1ad9b3b8ed45 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.898116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 452/901] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jul 12 14:21:11 2022] GET /identity/v3/endpoints?service_id=2d2f06fb4b934120bbfb3949f85c8ba0&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:11.903889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.950932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:12.008305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dcd66-0627-431d-900b-344314df5016 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:12.043817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a729d-efc6-4352-bd95-e35bfacc8535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:12.044857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a729d-efc6-4352-bd95-e35bfacc8535 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:12.045346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a729d-efc6-4352-bd95-e35bfacc8535 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:12.045841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a729d-efc6-4352-bd95-e35bfacc8535 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:12.046717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a729d-efc6-4352-bd95-e35bfacc8535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:12.048319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a729d-efc6-4352-bd95-e35bfacc8535 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:12.054706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 450/902] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:21:11 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:21:12.225710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7fc96-fff6-4cf5-bfe6-46e2da2c5a52 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:12.226057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7fc96-fff6-4cf5-bfe6-46e2da2c5a52 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:12.226269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7fc96-fff6-4cf5-bfe6-46e2da2c5a52 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:12.227930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 453/903] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:12.235684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e264-b7cb-4125-bfe5-f4db98b0dfa2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:12.235684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e264-b7cb-4125-bfe5-f4db98b0dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:12.235684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e264-b7cb-4125-bfe5-f4db98b0dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:12.252963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4373e264-b7cb-4125-bfe5-f4db98b0dfa2 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:12.254488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4373e264-b7cb-4125-bfe5-f4db98b0dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:12.326307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 451/904] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:12.346053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7fc96-fff6-4cf5-bfe6-46e2da2c5a52 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:12.455503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7fc96-fff6-4cf5-bfe6-46e2da2c5a52 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:12.473964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:12.493681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:12.494409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:12.494963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:12.495259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:12.495922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:12.497892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:12.511706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:12.512744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:12.513834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 454/905] 10.222.0.72 () {56 vars in 1132 bytes} [Tue Jul 12 14:21:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:12.521210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373e264-b7cb-4125-bfe5-f4db98b0dfa2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:12.565219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:12.629992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373e264-b7cb-4125-bfe5-f4db98b0dfa2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:12.665679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:12.666414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:12.666710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:12.667028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:12.667777 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:12.668097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:12.670052 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:12.675180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 452/906] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:12.680919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:12.782815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea787f-c5ac-4b07-b15d-183bc35f8977 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:12.817024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:12.817694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:12.817981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:12.818261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:12.819052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:12.819358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:12.820781 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:12.825985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 455/907] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:12.831873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:12.937479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497e31-307f-40e3-b3d5-fd0d818b877b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:12.939180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:12.973306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2a764-c366-4dbb-bdfe-f813bd457714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:12.973976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a764-c366-4dbb-bdfe-f813bd457714 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:12.974271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a764-c366-4dbb-bdfe-f813bd457714 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:12.974555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a764-c366-4dbb-bdfe-f813bd457714 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:12.975381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2a764-c366-4dbb-bdfe-f813bd457714 None admin] RBAC: Adding query filter params (interface=public, service_id=5bc9468862d0448e916d7bc59bbea0bf, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:12.975698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2a764-c366-4dbb-bdfe-f813bd457714 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:12.977071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2a764-c366-4dbb-bdfe-f813bd457714 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:12.983235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 453/908] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jul 12 14:21:12 2022] GET /identity/v3/endpoints?service_id=5bc9468862d0448e916d7bc59bbea0bf&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:12.988829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:13.036054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:13.096375 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76dd4-e766-4d7f-bfe9-0bd51871c845 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:13.131094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393d407-264c-4e57-a92c-4f86b3d694ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:13.132131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d407-264c-4e57-a92c-4f86b3d694ba None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.132629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d407-264c-4e57-a92c-4f86b3d694ba None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.133114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d407-264c-4e57-a92c-4f86b3d694ba None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.134005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393d407-264c-4e57-a92c-4f86b3d694ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:13.135719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393d407-264c-4e57-a92c-4f86b3d694ba None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:13.146889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 456/909] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:21:12 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:21:13.445913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e797-6705-4d04-aa60-955a90c72e46 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.446313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e797-6705-4d04-aa60-955a90c72e46 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.446517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e797-6705-4d04-aa60-955a90c72e46 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.448163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 454/910] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:13.453813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38b20-e80f-4790-9951-1fc712975a50 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.454110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38b20-e80f-4790-9951-1fc712975a50 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.454400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38b20-e80f-4790-9951-1fc712975a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.471473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-37c38b20-e80f-4790-9951-1fc712975a50 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:13.472651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-37c38b20-e80f-4790-9951-1fc712975a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:13.543510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 457/911] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:13.566207 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e797-6705-4d04-aa60-955a90c72e46 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:13.635971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a935-3343-40db-a615-7e30b15ebcdb None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.636302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a935-3343-40db-a615-7e30b15ebcdb None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.636537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a935-3343-40db-a615-7e30b15ebcdb None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.638590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 458/912] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:13.644642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08784-6237-4771-a894-52b744bf065b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.644642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08784-6237-4771-a894-52b744bf065b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.644642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08784-6237-4771-a894-52b744bf065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.663252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f9d08784-6237-4771-a894-52b744bf065b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:13.664784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f9d08784-6237-4771-a894-52b744bf065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:13.683642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e797-6705-4d04-aa60-955a90c72e46 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:13.702063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:13.728473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ee05e-9e78-4c59-9d09-1a3171f76205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:13.729992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee05e-9e78-4c59-9d09-1a3171f76205 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.731360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee05e-9e78-4c59-9d09-1a3171f76205 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.731846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee05e-9e78-4c59-9d09-1a3171f76205 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.733480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ee05e-9e78-4c59-9d09-1a3171f76205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:13.735682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ee05e-9e78-4c59-9d09-1a3171f76205 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:13.744563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 459/913] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:13.755080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 455/914] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:21:13 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:13.773175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08784-6237-4771-a894-52b744bf065b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:13.898734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08784-6237-4771-a894-52b744bf065b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:13.949845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ac82-e45a-4983-ba89-645abe1a95d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:13.951066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ac82-e45a-4983-ba89-645abe1a95d2 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.951585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ac82-e45a-4983-ba89-645abe1a95d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.952062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112ac82-e45a-4983-ba89-645abe1a95d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.963200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112ac82-e45a-4983-ba89-645abe1a95d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-b112ac82-e45a-4983-ba89-645abe1a95d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:13.971850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:13.972808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:13.973628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:13.975329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 460/915] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jul 12 14:21:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:13.980449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ee05e-9e78-4c59-9d09-1a3171f76205 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.010679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.097494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ee05e-9e78-4c59-9d09-1a3171f76205 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.132684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa772dd-e998-4c51-9964-5e133feef45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.133678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa772dd-e998-4c51-9964-5e133feef45c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.134162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa772dd-e998-4c51-9964-5e133feef45c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.134590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa772dd-e998-4c51-9964-5e133feef45c None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.135519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa772dd-e998-4c51-9964-5e133feef45c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:14.135997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa772dd-e998-4c51-9964-5e133feef45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.137539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa772dd-e998-4c51-9964-5e133feef45c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.146451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 456/916] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jul 12 14:21:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:14.152415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ac82-e45a-4983-ba89-645abe1a95d2 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.181261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.218749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c3b6-698b-4073-a896-a7998cc62964 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.219077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c3b6-698b-4073-a896-a7998cc62964 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.219572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c3b6-698b-4073-a896-a7998cc62964 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.221143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 457/917] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:14.225945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0213f-8749-43ad-af79-e13fff9688a6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.226249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0213f-8749-43ad-af79-e13fff9688a6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.226638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0213f-8749-43ad-af79-e13fff9688a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.244098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0bf0213f-8749-43ad-af79-e13fff9688a6 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:14.245245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0bf0213f-8749-43ad-af79-e13fff9688a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:14.267109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112ac82-e45a-4983-ba89-645abe1a95d2 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.307127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.308233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.309872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.310314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.322832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.324698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.328890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 458/918] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:14.348141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:14.349091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:14.349982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:14.349982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:14.349982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:14.349982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:14.352355 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 461/919] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:14.353395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0213f-8749-43ad-af79-e13fff9688a6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.362831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.390133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.438345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.461897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5561b-ebbb-4c7d-a936-4db1213c7c8a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.462716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0213f-8749-43ad-af79-e13fff9688a6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.497230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.497927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.498216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.498592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.499405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:14.499681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.500916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.501174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.502046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.502585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.503047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.503969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.505464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.518847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 462/920] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:14.521625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:14.522605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:21:14.523476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:14.524211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.524938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 459/921] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:14.531769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.634850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e860-0969-4d9e-ac1f-8c3b52f6cf4c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.635191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.657111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8adae-0bdc-4803-8a56-627c7bd43be9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.672366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.673444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.674012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.674473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.677625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.683257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.686193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.697903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.698585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.698926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.699212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.700460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:14.700769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.702192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:14.704662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:14.705569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:21:14.706500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:14.707760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 460/922] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:14.711413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.712226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 463/923] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:14.716647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.827171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc79a46-9360-4173-81e1-1953e9d0e836 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.847159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac6de4-73ae-45df-a43e-0ee5bb1e8e10 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.864105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.864874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.865161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.865441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.866208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:14.866524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.867958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.878319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 464/924] 10.222.0.72 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:14.879195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.891867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.892973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.893542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.893827 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.894677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:14.895274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.897459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.923524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 461/925] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:14.924529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.928917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.961315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.024366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658610a0-6e40-4749-ae0f-7322d87c5e44 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.038873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2276b-9411-4bf8-9326-34f1b3d3d8d1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.062107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7f4-4c71-49a6-aa98-d6c645d37400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.062832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7f4-4c71-49a6-aa98-d6c645d37400 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.063129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7f4-4c71-49a6-aa98-d6c645d37400 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.063416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7f4-4c71-49a6-aa98-d6c645d37400 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.064238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28d7f4-4c71-49a6-aa98-d6c645d37400 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.065681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28d7f4-4c71-49a6-aa98-d6c645d37400 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.082862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdded6d6-7e3e-417e-9a18-9ef736ed29e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.084110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdded6d6-7e3e-417e-9a18-9ef736ed29e9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.084620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdded6d6-7e3e-417e-9a18-9ef736ed29e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.085108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdded6d6-7e3e-417e-9a18-9ef736ed29e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.095236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 465/926] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:21:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:15.100863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdded6d6-7e3e-417e-9a18-9ef736ed29e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.102856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdded6d6-7e3e-417e-9a18-9ef736ed29e9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-fdded6d6-7e3e-417e-9a18-9ef736ed29e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:15.124731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:15.125744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:15.126711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:15.126711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:15.126711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:15.126711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:15.129148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 462/927] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:15.134863 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7f4-4c71-49a6-aa98-d6c645d37400 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.256437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7f4-4c71-49a6-aa98-d6c645d37400 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.271299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.295876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.296562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.296839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.297122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.297853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:15.298167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.299585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.304725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa8d8f-2ca1-4d5e-b398-0fe199b0ddbc None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.305022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa8d8f-2ca1-4d5e-b398-0fe199b0ddbc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.305303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa8d8f-2ca1-4d5e-b398-0fe199b0ddbc None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.306666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 463/928] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:15.312535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ab75-7f5c-4ec7-a3ad-6764f4eae44c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.312535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ab75-7f5c-4ec7-a3ad-6764f4eae44c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.312734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 466/929] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:15.312823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ab75-7f5c-4ec7-a3ad-6764f4eae44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.317969 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.333065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fd32ab75-7f5c-4ec7-a3ad-6764f4eae44c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:15.334293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fd32ab75-7f5c-4ec7-a3ad-6764f4eae44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:15.408073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.424431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ae1bd-c27d-4480-9875-7f4e37a550fe None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.425809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 464/930] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:15.448533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ab75-7f5c-4ec7-a3ad-6764f4eae44c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.466685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.467532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.467826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.468107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.475429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.477014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:15.492941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:15.493907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:15.495225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 467/931] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:15.500710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.533551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.550810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ab75-7f5c-4ec7-a3ad-6764f4eae44c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.586263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.587404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.587692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.587973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.589097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.591321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:15.607704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:15.608999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:21:15.610028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:15.611134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 465/932] 10.222.0.72 () {56 vars in 1132 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:15.614846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.617644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424612-22d1-41e7-891a-de2d6185be7c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.657528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.658203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.658496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.658795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.659798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:15.660121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.661576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.680107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.680342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 468/933] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:15.682020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.728267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4adb21-ff06-448f-9ccf-cced2b4c7c2a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.767941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.768617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.768903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.769179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.769886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:15.770195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.771590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.778843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 466/934] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:15.783750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.802102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.814369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450e927-5f3e-45d8-a391-b7068c67524c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.867722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52cb94-66b7-4367-a12e-4bbf54abb611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.868629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52cb94-66b7-4367-a12e-4bbf54abb611 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.869466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52cb94-66b7-4367-a12e-4bbf54abb611 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.869815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52cb94-66b7-4367-a12e-4bbf54abb611 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/6c7f048f7f1c4df1a9f6dca0fc4ce75a/roles/ab280a3ac3d2432ca85d4f2bf884c19c` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.872429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52cb94-66b7-4367-a12e-4bbf54abb611 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=6c7f048f7f1c4df1a9f6dca0fc4ce75a, role_id=ab280a3ac3d2432ca85d4f2bf884c19c)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.875099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52cb94-66b7-4367-a12e-4bbf54abb611 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.894860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 469/935] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:15 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/6c7f048f7f1c4df1a9f6dca0fc4ce75a/roles/ab280a3ac3d2432ca85d4f2bf884c19c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:15.917419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facbb49-9de1-4e71-aa5b-a8e4b731d651 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.935424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.958225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.959004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.959292 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.959574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.960358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:15.960723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.962259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.962901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524524-c4f9-4db0-9bee-521c80a93de5 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.963352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524524-c4f9-4db0-9bee-521c80a93de5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.963538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75524524-c4f9-4db0-9bee-521c80a93de5 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.965596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 470/936] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:15.969221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 467/937] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:15.973605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5b3c-e143-4c26-a3be-773b1a1faf46 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.973605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5b3c-e143-4c26-a3be-773b1a1faf46 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.973605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5b3c-e143-4c26-a3be-773b1a1faf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.975749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.992639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-57dc5b3c-e143-4c26-a3be-773b1a1faf46 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:15.993880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-57dc5b3c-e143-4c26-a3be-773b1a1faf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:16.073994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 471/938] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:16.098313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d5352-1013-475e-9370-ea6d08b90bf8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.099204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc5b3c-e143-4c26-a3be-773b1a1faf46 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.140294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d77da1-960b-4692-b814-c4d186617819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.141329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d77da1-960b-4692-b814-c4d186617819 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.141638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d77da1-960b-4692-b814-c4d186617819 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.141927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d77da1-960b-4692-b814-c4d186617819 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.143115 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d77da1-960b-4692-b814-c4d186617819 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.144810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d77da1-960b-4692-b814-c4d186617819 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.174841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 468/939] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:21:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:16.193672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.217594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc5b3c-e143-4c26-a3be-773b1a1faf46 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.265397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.266233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.266515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.266813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.267484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.269005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:16.282835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:16.283893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:16.285384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 472/940] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:16.290277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d77da1-960b-4692-b814-c4d186617819 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.336153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.409452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d77da1-960b-4692-b814-c4d186617819 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.445713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.446400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.446690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.447054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.447770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:16.448129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.449557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.454932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 469/941] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:16.460134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.563059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74e12-08ba-4595-8e52-94d2b9725726 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.597521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.598197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.598487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.598787 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.599508 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:16.599821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.601204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.607196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 473/942] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:16.612800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.724550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.729018 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42374821-b84a-4ac3-99fa-678946a8cba4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.767439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8659c36-ea2c-4417-958e-fba32b5892e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.768484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659c36-ea2c-4417-958e-fba32b5892e9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.768989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659c36-ea2c-4417-958e-fba32b5892e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.769490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8659c36-ea2c-4417-958e-fba32b5892e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.770476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8659c36-ea2c-4417-958e-fba32b5892e9 None admin] RBAC: Adding query filter params (interface=public, service_id=107c9f48d38e422a9767ec624c247e26, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:16.771069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8659c36-ea2c-4417-958e-fba32b5892e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.772640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8659c36-ea2c-4417-958e-fba32b5892e9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.779238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 470/943] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/endpoints?service_id=107c9f48d38e422a9767ec624c247e26&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:16.786802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.794055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.893165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd287d4-2c1e-4677-bce1-60722921c5ee None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.929882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f276a15-7fbe-4834-9bf5-84e7b21fe226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.930579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276a15-7fbe-4834-9bf5-84e7b21fe226 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.930897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276a15-7fbe-4834-9bf5-84e7b21fe226 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.931183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276a15-7fbe-4834-9bf5-84e7b21fe226 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.931882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f276a15-7fbe-4834-9bf5-84e7b21fe226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.933306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f276a15-7fbe-4834-9bf5-84e7b21fe226 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.940623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 474/944] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:21:17.268637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f12b-5a27-41b1-b99a-1ecd80342387 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.269189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f12b-5a27-41b1-b99a-1ecd80342387 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.269189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f12b-5a27-41b1-b99a-1ecd80342387 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.270869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 471/945] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:17.276021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732129-fda5-4698-a94e-4cd079709897 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.276461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732129-fda5-4698-a94e-4cd079709897 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.276630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732129-fda5-4698-a94e-4cd079709897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.296383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-9e732129-fda5-4698-a94e-4cd079709897 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:17.297601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9e732129-fda5-4698-a94e-4cd079709897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:17.365819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:17.371351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 475/946] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:17.394499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5f12b-5a27-41b1-b99a-1ecd80342387 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.507686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5f12b-5a27-41b1-b99a-1ecd80342387 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.544256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.544930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.545224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.545506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.546223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.547710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.549190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING keystone.server.flask.common [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 14:21:17.568700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.sql.core [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 14:21:17.568700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 14:21:17.568700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [parameters: {'id': '2c2ab513d0d2437897d4744832322dd2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 14:21:17.568700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80443) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c2ab513d0d2437897d4744832322dd2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c2ab513d0d2437897d4744832322dd2. Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:21:17.587092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application result.read() Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 14:21:17.590479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application yield resource Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise self.value Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application session.commit() Jul 12 14:21:17.591620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.session.flush() Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application compat.raise_( Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 14:21:17.592518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 14:21:17.593402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application result.read() Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:21:17.594211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [parameters: {'id': '2c2ab513d0d2437897d4744832322dd2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:17.595220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:17.596072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c2ab513d0d2437897d4744832322dd2. Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:17.597032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 472/947] 10.222.0.72 () {60 vars in 1140 bytes} [Tue Jul 12 14:21:17 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:17.597577 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e732129-fda5-4698-a94e-4cd079709897 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.711387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e732129-fda5-4698-a94e-4cd079709897 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.746797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7a861-ee21-495e-a162-c5d0ed86864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.747605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a861-ee21-495e-a162-c5d0ed86864a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.747896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a861-ee21-495e-a162-c5d0ed86864a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.748177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a861-ee21-495e-a162-c5d0ed86864a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.755112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7a861-ee21-495e-a162-c5d0ed86864a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.756575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7a861-ee21-495e-a162-c5d0ed86864a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-9fb7a861-ee21-495e-a162-c5d0ed86864a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:17.770870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:17.771733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:17.772591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 476/948] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:17.779888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.803845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:17.885315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c2bf2-4751-4dba-b7c1-4e626506ab67 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.925094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c860a00-04ba-4c64-9a24-43c09003327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.926118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c860a00-04ba-4c64-9a24-43c09003327b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.926609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c860a00-04ba-4c64-9a24-43c09003327b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.927120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c860a00-04ba-4c64-9a24-43c09003327b None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.928110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c860a00-04ba-4c64-9a24-43c09003327b None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:17.928620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c860a00-04ba-4c64-9a24-43c09003327b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.930457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c860a00-04ba-4c64-9a24-43c09003327b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.952361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 473/949] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:18.051152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c11e-6da3-47b0-a5c6-55a65b19c13c None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.051359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c11e-6da3-47b0-a5c6-55a65b19c13c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.051633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c11e-6da3-47b0-a5c6-55a65b19c13c None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.053533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 477/950] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:18.059755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bf013-45b9-4794-a73c-77a740c847db None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.060380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bf013-45b9-4794-a73c-77a740c847db None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.060870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bf013-45b9-4794-a73c-77a740c847db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.084287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-de8bf013-45b9-4794-a73c-77a740c847db None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:18.086256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-de8bf013-45b9-4794-a73c-77a740c847db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:18.164294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 474/951] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:18.187941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5c11e-6da3-47b0-a5c6-55a65b19c13c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.254018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.299403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5c11e-6da3-47b0-a5c6-55a65b19c13c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.335438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48a6f7-ece0-4919-aa0d-cb13e1acaa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.336579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a6f7-ece0-4919-aa0d-cb13e1acaa84 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.337079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a6f7-ece0-4919-aa0d-cb13e1acaa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.337571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a6f7-ece0-4919-aa0d-cb13e1acaa84 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.348985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48a6f7-ece0-4919-aa0d-cb13e1acaa84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-7c48a6f7-ece0-4919-aa0d-cb13e1acaa84 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:18.357452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:18.358586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:18.359463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:18.361976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 478/952] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:18.368172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bf013-45b9-4794-a73c-77a740c847db None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.379184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.423483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962085-5b7c-4b61-a049-24961f7ba3e7 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.424115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962085-5b7c-4b61-a049-24961f7ba3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.424610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962085-5b7c-4b61-a049-24961f7ba3e7 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.426318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 479/953] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:18.431733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576313f-38e4-49d9-9732-3d77fbf049cf None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.432295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576313f-38e4-49d9-9732-3d77fbf049cf None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.432905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576313f-38e4-49d9-9732-3d77fbf049cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.451309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5576313f-38e4-49d9-9732-3d77fbf049cf None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:18.452965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5576313f-38e4-49d9-9732-3d77fbf049cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:18.474044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bf013-45b9-4794-a73c-77a740c847db None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.518076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.519475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.520208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.520639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.521808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:18.522661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.524562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.534441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 475/954] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:18.539040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 480/955] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:18.540273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576313f-38e4-49d9-9732-3d77fbf049cf None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.551633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.603799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.643527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.662800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576313f-38e4-49d9-9732-3d77fbf049cf None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.684512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4dc71-156d-49b6-a5ff-8b2f65922677 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.703725 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.704922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.705413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.705953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.716993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.718795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.723512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.724327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.724614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.724892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.725549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.726925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:18.739124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:18.740340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:18.741212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:18.743140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:18.743988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:18.745486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:18.745486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:18.745486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:18.745486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:18.746558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 476/956] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:18.746558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.748233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 481/957] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:18.753953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.852439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1d9c-f8dd-4487-af3b-3fcd38a14722 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.864156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f098f-fe08-4a9b-a180-4a140d5fedb5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.865928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.889637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.890343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.890589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.890904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.891615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:18.891920 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.893637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.894585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.904140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 477/958] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:18.905606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.908309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.909211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.909597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.910680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.910990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:18.911399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.912993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.930598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 482/959] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:18.931596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.013440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589886bf-7cfd-45bf-bfb1-afe703535c7d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.048601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f6aa0-c719-4789-beae-7108db05560b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.050342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad00542-79d3-45a7-883e-3a95520fad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.051381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00542-79d3-45a7-883e-3a95520fad61 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.051876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00542-79d3-45a7-883e-3a95520fad61 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.052390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00542-79d3-45a7-883e-3a95520fad61 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.053107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad00542-79d3-45a7-883e-3a95520fad61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:19.053416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad00542-79d3-45a7-883e-3a95520fad61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.054802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad00542-79d3-45a7-883e-3a95520fad61 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.060622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 478/960] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:19.068367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f38c6-3219-4432-9647-1d7e14124579 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.068658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f38c6-3219-4432-9647-1d7e14124579 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.068941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f38c6-3219-4432-9647-1d7e14124579 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.070591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 479/961] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:19.076209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9149183-c336-42a1-80c7-0ff9056f9f6e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.076508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9149183-c336-42a1-80c7-0ff9056f9f6e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.076802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9149183-c336-42a1-80c7-0ff9056f9f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.095099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b9149183-c336-42a1-80c7-0ff9056f9f6e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:19.096507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b9149183-c336-42a1-80c7-0ff9056f9f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:19.098884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.101090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.101575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.102007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.113357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.116079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:19.136929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:19.138131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:21:19.139310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:19.143121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 483/962] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:19.148596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.170631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.186459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 480/963] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:19.193159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.209818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9149183-c336-42a1-80c7-0ff9056f9f6e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.286130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17913af-3db0-4aeb-b305-e62b206ff0f1 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.328065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.328738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.329038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.329743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.330891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:19.331213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.333333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.340513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9149183-c336-42a1-80c7-0ff9056f9f6e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.357267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 484/964] 10.222.0.72 () {56 vars in 1149 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:19.362789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.379910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.381555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.382154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.382611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.383763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.385400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:19.402666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:19.403906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:19.405038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:19.410806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 481/965] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:19.413358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.456184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.472232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.479064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11680236-9778-45e3-9d8b-e34875659842 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.517751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271121e-cfdb-4936-a139-8c7e4a7da76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.518421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b60fb6-771a-4b21-b96c-cd1176fc9a80 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.518985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271121e-cfdb-4936-a139-8c7e4a7da76b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.519473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271121e-cfdb-4936-a139-8c7e4a7da76b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.520088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271121e-cfdb-4936-a139-8c7e4a7da76b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.556072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.556756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.557047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.557331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.558044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:19.558391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.560224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.569838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 482/966] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:19.570715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.595885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271121e-cfdb-4936-a139-8c7e4a7da76b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.597760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271121e-cfdb-4936-a139-8c7e4a7da76b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.674378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a0097-a511-4971-bce6-e60698758a6e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.694947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.708097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.709762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.710448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.710757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.711057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.712239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:19.712239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.712515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 485/967] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:19.713513 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271121e-cfdb-4936-a139-8c7e4a7da76b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.713629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.724656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 483/968] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:19.725544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.820677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271121e-cfdb-4936-a139-8c7e4a7da76b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.829733 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9019d8-678c-482a-a820-06330e52ba58 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.860647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.861715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.862073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.862421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.866311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e42725-b15c-4955-bf71-0d04104f3931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.867030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42725-b15c-4955-bf71-0d04104f3931 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.867322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42725-b15c-4955-bf71-0d04104f3931 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.867605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42725-b15c-4955-bf71-0d04104f3931 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.868357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e42725-b15c-4955-bf71-0d04104f3931 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.869723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e42725-b15c-4955-bf71-0d04104f3931 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.874049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.875543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:19.893420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:19.894320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:19.895271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:19.895271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:19.895271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:19.895271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:19.899128 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 486/969] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:19.900621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.902461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 484/970] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:21:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:19.942891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.024374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed020a70-6d7a-4fc0-9684-bcb49cca3e76 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.074383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded43ad-ed30-4f96-b973-76604d10b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.075324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded43ad-ed30-4f96-b973-76604d10b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.075761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded43ad-ed30-4f96-b973-76604d10b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.076190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded43ad-ed30-4f96-b973-76604d10b6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.077059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded43ad-ed30-4f96-b973-76604d10b6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:20.077533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded43ad-ed30-4f96-b973-76604d10b6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.079112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded43ad-ed30-4f96-b973-76604d10b6f8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.091829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 487/971] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:20.097963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e42725-b15c-4955-bf71-0d04104f3931 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.145261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.195332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bd850-4907-4fc5-8aaf-81068ff40d93 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.195538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bd850-4907-4fc5-8aaf-81068ff40d93 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.195827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bd850-4907-4fc5-8aaf-81068ff40d93 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.201072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 488/972] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:20.202733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7eff5-be07-48a5-be4b-8d4e717b603c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.203200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7eff5-be07-48a5-be4b-8d4e717b603c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.203519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7eff5-be07-48a5-be4b-8d4e717b603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.210599 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e42725-b15c-4955-bf71-0d04104f3931 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.221309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-27d7eff5-be07-48a5-be4b-8d4e717b603c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:20.222630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-27d7eff5-be07-48a5-be4b-8d4e717b603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:20.257976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.258919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.259299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.259694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.268029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.269631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:20.285499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:20.286425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:20.287341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 485/973] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:20.294192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.310894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 489/974] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:20.326867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7eff5-be07-48a5-be4b-8d4e717b603c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.352454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.418486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.423151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bc2e0-c8c2-4b48-b341-66a64a577310 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.445570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7eff5-be07-48a5-be4b-8d4e717b603c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.466558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.467910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.468645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.469098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.470189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:20.470984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.472998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.482125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.482907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.483262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.483606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.484704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.486024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.487421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING keystone.server.flask.common [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 14:21:20.488513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 486/975] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:20.497920 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.502159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.sql.core [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 14:21:20.502159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 14:21:20.502159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [parameters: {'user_id': '64dffcf7d38a408db5d7c62e8c4de2e1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 14:21:20.502159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80444) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result.read() Jul 12 14:21:20.514439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:21:20.515363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application yield resource Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise self.value Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application session.commit() Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 14:21:20.516342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.session.flush() Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application compat.raise_( Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 14:21:20.517522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:21:20.518461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application result.read() Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:21:20.519330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [parameters: {'user_id': '64dffcf7d38a408db5d7c62e8c4de2e1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:20.520228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 14:21:20.521014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 14:21:20.521907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 14:21:20.521907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 14:21:20.521907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 14:21:20.521907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 14:21:20.521907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 14:21:20.521907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:20.521907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 490/976] 10.222.0.72 () {60 vars in 1131 bytes} [Tue Jul 12 14:21:20 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:20.530091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.619048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.639858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0c547-fd45-4598-869f-5d2f4b764f02 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.652982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b6e1a-94b3-4b59-980a-ed13cd18bd3e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.677186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.677970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.678329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.678684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.679656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] RBAC: Adding query filter params (role.id=ab280a3ac3d2432ca85d4f2bf884c19c, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=6c7f048f7f1c4df1a9f6dca0fc4ce75a) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:20.680060 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.681584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.696449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 487/977] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/role_assignments?user.id=6c7f048f7f1c4df1a9f6dca0fc4ce75a&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=ab280a3ac3d2432ca85d4f2bf884c19c => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:20.708310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87090b47-3a37-4cb4-bf2a-1627026b67d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.709195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87090b47-3a37-4cb4-bf2a-1627026b67d3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.709489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87090b47-3a37-4cb4-bf2a-1627026b67d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.709768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87090b47-3a37-4cb4-bf2a-1627026b67d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.719118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87090b47-3a37-4cb4-bf2a-1627026b67d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.720927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87090b47-3a37-4cb4-bf2a-1627026b67d3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-87090b47-3a37-4cb4-bf2a-1627026b67d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:20.737557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:20.738607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:21:20.739575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:20.743863 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 491/978] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:20.745331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.776140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.859842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2c6d-091e-4bc9-8f16-983d38da1737 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.904260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3d727-1a12-4682-bfd3-06bda3af0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.904260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3d727-1a12-4682-bfd3-06bda3af0491 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.904260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3d727-1a12-4682-bfd3-06bda3af0491 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.904260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3d727-1a12-4682-bfd3-06bda3af0491 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.904681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3d727-1a12-4682-bfd3-06bda3af0491 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:20.904959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3d727-1a12-4682-bfd3-06bda3af0491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.906519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3d727-1a12-4682-bfd3-06bda3af0491 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.949354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 488/979] 10.222.0.72 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:21.186418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e86ef-2cd0-433e-b29b-6bf28ebb606f None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.186800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e86ef-2cd0-433e-b29b-6bf28ebb606f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.187026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e86ef-2cd0-433e-b29b-6bf28ebb606f None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.191392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 492/980] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:21.196647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774612-c4b7-4824-b040-2f4978717d7a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.196945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774612-c4b7-4824-b040-2f4978717d7a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.197234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774612-c4b7-4824-b040-2f4978717d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.215373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ae774612-c4b7-4824-b040-2f4978717d7a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:21.216489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ae774612-c4b7-4824-b040-2f4978717d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:21.285175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 489/981] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:21.309063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e86ef-2cd0-433e-b29b-6bf28ebb606f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:21.408864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e86ef-2cd0-433e-b29b-6bf28ebb606f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:21.442973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc58d1b-f575-4861-a702-36267d7b0e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:21.443645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc58d1b-f575-4861-a702-36267d7b0e60 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.443932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc58d1b-f575-4861-a702-36267d7b0e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.444213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc58d1b-f575-4861-a702-36267d7b0e60 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.444927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc58d1b-f575-4861-a702-36267d7b0e60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:21.446297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc58d1b-f575-4861-a702-36267d7b0e60 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:21.454893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:21.461653 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 493/982] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:21:21 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:22.012817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d127ea-b1e6-40b5-b393-d52b3d69ed04 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.013331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d127ea-b1e6-40b5-b393-d52b3d69ed04 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.013407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d127ea-b1e6-40b5-b393-d52b3d69ed04 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.014909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 490/983] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:22.019822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502b657-fe43-4666-9f02-fee5874deb3a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.020126 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502b657-fe43-4666-9f02-fee5874deb3a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.020410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502b657-fe43-4666-9f02-fee5874deb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.038069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1502b657-fe43-4666-9f02-fee5874deb3a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:22.039607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1502b657-fe43-4666-9f02-fee5874deb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:22.115273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 494/984] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:22.137639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d127ea-b1e6-40b5-b393-d52b3d69ed04 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.153413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.239942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d127ea-b1e6-40b5-b393-d52b3d69ed04 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.273326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.274068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.274353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.274629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.275312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.277512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:22.289356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:22.290308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:22.291199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 491/985] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:22.298170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502b657-fe43-4666-9f02-fee5874deb3a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.395679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502b657-fe43-4666-9f02-fee5874deb3a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.420953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.431270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.431952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.432240 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.432522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.433763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:22.434075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.435487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.440585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 495/986] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:22.446004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.523648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.547699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b3ed-81bf-4edb-9be8-4a695d2c8349 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.584086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.584764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.585053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.585336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.586062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:22.586353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.587745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.592773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 492/987] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:22.598380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.696820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79e87-a233-43c3-b4d9-40bb6c3d769b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.731346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb96ab-e0f7-4a77-8cc3-bc79b508db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.732018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb96ab-e0f7-4a77-8cc3-bc79b508db17 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.732308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb96ab-e0f7-4a77-8cc3-bc79b508db17 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.732587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb96ab-e0f7-4a77-8cc3-bc79b508db17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.733388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb96ab-e0f7-4a77-8cc3-bc79b508db17 None admin] RBAC: Adding query filter params (interface=admin, service_id=107c9f48d38e422a9767ec624c247e26, region_id=RegionOne) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:22.733706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb96ab-e0f7-4a77-8cc3-bc79b508db17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.735104 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb96ab-e0f7-4a77-8cc3-bc79b508db17 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.744682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 496/988] 10.222.0.72 () {56 vars in 1249 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/endpoints?service_id=107c9f48d38e422a9767ec624c247e26&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:22.746457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.822109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7f17-6f4c-4b5e-9e9b-9cef98d67251 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.822408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7f17-6f4c-4b5e-9e9b-9cef98d67251 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.822620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7f17-6f4c-4b5e-9e9b-9cef98d67251 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.824233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 497/989] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:22.828949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8646-4b4a-45c8-bf44-eee532babbde None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.829241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8646-4b4a-45c8-bf44-eee532babbde None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.829525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8646-4b4a-45c8-bf44-eee532babbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.846381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-0a3a8646-4b4a-45c8-bf44-eee532babbde None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:22.847590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0a3a8646-4b4a-45c8-bf44-eee532babbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:22.860966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cb282-8023-4dca-ada2-60b0b745b526 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.896020 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a6c5f-b831-4039-a1f8-6a4a351ee379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.896697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6c5f-b831-4039-a1f8-6a4a351ee379 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.896989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6c5f-b831-4039-a1f8-6a4a351ee379 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.897269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6c5f-b831-4039-a1f8-6a4a351ee379 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.897957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a6c5f-b831-4039-a1f8-6a4a351ee379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.899363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a6c5f-b831-4039-a1f8-6a4a351ee379 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.903147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.914799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 493/990] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:21:22.922553 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 498/991] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:22.945831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a6c5f-b831-4039-a1f8-6a4a351ee379 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.949903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:23.061698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a6c5f-b831-4039-a1f8-6a4a351ee379 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.099071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.099804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.100091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.100368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] PATH_INFO: `/v3/services/image` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.101031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:23.102392 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:23.114723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:23.115764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:23.117117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 494/992] 10.222.0.72 () {56 vars in 1105 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:23.122219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a8646-4b4a-45c8-bf44-eee532babbde None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.224060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a8646-4b4a-45c8-bf44-eee532babbde None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.258203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf6d2a-bda2-44ba-9075-3a9b78bc54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.258907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf6d2a-bda2-44ba-9075-3a9b78bc54cc None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.259202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf6d2a-bda2-44ba-9075-3a9b78bc54cc None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.259485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf6d2a-bda2-44ba-9075-3a9b78bc54cc None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.260203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf6d2a-bda2-44ba-9075-3a9b78bc54cc None admin] RBAC: Adding query filter params (name=image) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:23.260515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf6d2a-bda2-44ba-9075-3a9b78bc54cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:23.261929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf6d2a-bda2-44ba-9075-3a9b78bc54cc None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.271374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 499/993] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:23.272627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.343530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:23.381307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c136aad-0ef4-4b1c-b45c-eba88a1f7451 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.415389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d87df-4506-48f9-8115-eba00486ee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.416063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d87df-4506-48f9-8115-eba00486ee90 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.416356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d87df-4506-48f9-8115-eba00486ee90 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.416638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d87df-4506-48f9-8115-eba00486ee90 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.417974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d87df-4506-48f9-8115-eba00486ee90 None admin] RBAC: Adding query filter params (type=image) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:23.418285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d87df-4506-48f9-8115-eba00486ee90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:23.419672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d87df-4506-48f9-8115-eba00486ee90 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.431088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 495/994] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:23.484908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a129e3-029f-4b0a-a5b3-51f5ec71e033 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.485435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a129e3-029f-4b0a-a5b3-51f5ec71e033 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.485541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a129e3-029f-4b0a-a5b3-51f5ec71e033 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.487058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 500/995] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:23.492428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5495a-2221-464f-80ef-b0016913892b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.492725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5495a-2221-464f-80ef-b0016913892b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.493009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5495a-2221-464f-80ef-b0016913892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.510410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-eac5495a-2221-464f-80ef-b0016913892b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:23.512185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-eac5495a-2221-464f-80ef-b0016913892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:23.589739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 496/996] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:23.612314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a129e3-029f-4b0a-a5b3-51f5ec71e033 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.664757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:23.717658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a129e3-029f-4b0a-a5b3-51f5ec71e033 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.750788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.751602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.751894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.752174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.752826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:23.754212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:23.766583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:23.767542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:23.768370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:23.770884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 501/997] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:23.774190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5495a-2221-464f-80ef-b0016913892b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.835234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:23.875461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5495a-2221-464f-80ef-b0016913892b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.910114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.910810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.911106 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.911388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.912091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:23.912406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:23.913772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.918843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 497/998] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:23.924312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.027826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705284-3b30-4376-b19c-9e979d214bcb None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.040832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.071188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.071882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.072172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.072458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.073171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:24.074110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.075530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.080809 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 502/999] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:24.086547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.187095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7c6f-b7dd-4af1-84e3-8b91ca621bb5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.212396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.221786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40f5a3-6878-4298-a4f5-23ff7a3b2926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.222452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f5a3-6878-4298-a4f5-23ff7a3b2926 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.222745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f5a3-6878-4298-a4f5-23ff7a3b2926 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.223056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f5a3-6878-4298-a4f5-23ff7a3b2926 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.223849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40f5a3-6878-4298-a4f5-23ff7a3b2926 None admin] RBAC: Adding query filter params (interface=public, service_id=8ffcbe61d0274944897fce04860695b8, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:24.224166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40f5a3-6878-4298-a4f5-23ff7a3b2926 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.225530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40f5a3-6878-4298-a4f5-23ff7a3b2926 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.231212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 498/1000] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/endpoints?service_id=8ffcbe61d0274944897fce04860695b8&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:24.236691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.334558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d3e7-fe39-46ad-b67e-563d93a89745 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.367758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b62ed-0a64-4706-a994-2dc762571230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.368437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b62ed-0a64-4706-a994-2dc762571230 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.368730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b62ed-0a64-4706-a994-2dc762571230 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.369016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b62ed-0a64-4706-a994-2dc762571230 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.369702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b62ed-0a64-4706-a994-2dc762571230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.371640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b62ed-0a64-4706-a994-2dc762571230 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.378033 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 503/1001] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:21:24.935982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f89fda-864d-451e-a86e-82a862ace3e2 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.936349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f89fda-864d-451e-a86e-82a862ace3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.936559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f89fda-864d-451e-a86e-82a862ace3e2 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.938098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 499/1002] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:24.943027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6646a-bebf-4aa7-8412-02b3593023f2 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.943481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6646a-bebf-4aa7-8412-02b3593023f2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.943646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6646a-bebf-4aa7-8412-02b3593023f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.959981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-96a6646a-bebf-4aa7-8412-02b3593023f2 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:24.961159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-96a6646a-bebf-4aa7-8412-02b3593023f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:24.997094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.034890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 504/1003] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:25.055747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f89fda-864d-451e-a86e-82a862ace3e2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.162291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f89fda-864d-451e-a86e-82a862ace3e2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.195654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.196398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.196689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.196972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.197627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.199532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:25.211492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:25.212462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:21:25.213291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:25.218179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 500/1004] 10.222.0.72 () {56 vars in 1126 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:25.219563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6646a-bebf-4aa7-8412-02b3593023f2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.316646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6646a-bebf-4aa7-8412-02b3593023f2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.352199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f33df-17f9-434b-9cf4-6af8ff57c8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.352930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f33df-17f9-434b-9cf4-6af8ff57c8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.353228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f33df-17f9-434b-9cf4-6af8ff57c8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.353511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f33df-17f9-434b-9cf4-6af8ff57c8b7 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.354225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f33df-17f9-434b-9cf4-6af8ff57c8b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:25.354565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f33df-17f9-434b-9cf4-6af8ff57c8b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.356134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f33df-17f9-434b-9cf4-6af8ff57c8b7 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.361124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 505/1005] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:25.366841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.424137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.467585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca399b-b5f8-4d5e-ba3f-a4c56af1bb91 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.467891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca399b-b5f8-4d5e-ba3f-a4c56af1bb91 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.468118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca399b-b5f8-4d5e-ba3f-a4c56af1bb91 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.469562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 506/1006] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:25.474861 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f943b3-24c5-4615-8d08-1873a095b4e4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.475521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4ce34-607f-4ebf-8ee1-a6e469daea49 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.475825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4ce34-607f-4ebf-8ee1-a6e469daea49 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.476114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4ce34-607f-4ebf-8ee1-a6e469daea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.493666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-45a4ce34-607f-4ebf-8ee1-a6e469daea49 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:25.494902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-45a4ce34-607f-4ebf-8ee1-a6e469daea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:25.514008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.514694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.515002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.515282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.515995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:25.516305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.517711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.522595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 501/1007] 10.222.0.72 () {56 vars in 1122 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:25.525572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.528988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.569389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 507/1008] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:25.592973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4ce34-607f-4ebf-8ee1-a6e469daea49 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.629896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587842f-e0a6-42aa-91de-59276ef98b59 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.648158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.667613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a900ddb-c29c-4ccc-84a0-a209f4287169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.668010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900ddb-c29c-4ccc-84a0-a209f4287169 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.668294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900ddb-c29c-4ccc-84a0-a209f4287169 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.668569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900ddb-c29c-4ccc-84a0-a209f4287169 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.669303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a900ddb-c29c-4ccc-84a0-a209f4287169 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.670654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a900ddb-c29c-4ccc-84a0-a209f4287169 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.698822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 502/1009] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:21:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:25.714229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4ce34-607f-4ebf-8ee1-a6e469daea49 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.759283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46da8d-e619-40f2-bc2f-33960f40afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.759893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46da8d-e619-40f2-bc2f-33960f40afd2 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.760182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46da8d-e619-40f2-bc2f-33960f40afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.760464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46da8d-e619-40f2-bc2f-33960f40afd2 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.761254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46da8d-e619-40f2-bc2f-33960f40afd2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.762692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46da8d-e619-40f2-bc2f-33960f40afd2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.787172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 508/1010] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:21:25 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:26.397630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260257-45db-4212-9045-0775837e5dc8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.398133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260257-45db-4212-9045-0775837e5dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.398222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260257-45db-4212-9045-0775837e5dc8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.399808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 503/1011] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:26.405605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acf1d6-b56c-4fe7-b132-339ffccd9c89 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.406037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acf1d6-b56c-4fe7-b132-339ffccd9c89 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.406208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acf1d6-b56c-4fe7-b132-339ffccd9c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.423336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b9acf1d6-b56c-4fe7-b132-339ffccd9c89 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:26.424524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b9acf1d6-b56c-4fe7-b132-339ffccd9c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:26.439411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:26.500740 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 509/1012] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:26.523878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90260257-45db-4212-9045-0775837e5dc8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.621618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90260257-45db-4212-9045-0775837e5dc8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.654671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.655443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.655731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.656009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.656656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.658010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:26.669543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:26.670502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:21:26.671919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:26.672999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 504/1013] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:26.676567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acf1d6-b56c-4fe7-b132-339ffccd9c89 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.772937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acf1d6-b56c-4fe7-b132-339ffccd9c89 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.812456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.813143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.813431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.813710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.814419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:26.814729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.816140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.826883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 510/1014] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:26.828669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.878657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:26.940456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f157fc-68c4-4813-8286-64a0141c07ea None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.974157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da7954-1055-4603-b024-5d3851fed95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.974846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da7954-1055-4603-b024-5d3851fed95d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.975140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da7954-1055-4603-b024-5d3851fed95d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.975429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da7954-1055-4603-b024-5d3851fed95d None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.976137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da7954-1055-4603-b024-5d3851fed95d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:26.976448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da7954-1055-4603-b024-5d3851fed95d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.977811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da7954-1055-4603-b024-5d3851fed95d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.987470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 505/1015] 10.222.0.72 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:26.988388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:27.001051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:27.095479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d24bb3-4f05-4d7c-9ab5-e48c840e34e4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:27.129008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6a8f8-30f7-497a-a225-18674a5f614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:27.129663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6a8f8-30f7-497a-a225-18674a5f614b None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:27.129952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6a8f8-30f7-497a-a225-18674a5f614b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:27.130227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6a8f8-30f7-497a-a225-18674a5f614b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:27.130991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6a8f8-30f7-497a-a225-18674a5f614b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:27.132356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6a8f8-30f7-497a-a225-18674a5f614b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:27.150930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 511/1016] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:21:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:27.743780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c787fb-f6ea-49a0-9b3e-7ce159ace8d2 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:27.744331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c787fb-f6ea-49a0-9b3e-7ce159ace8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:27.744331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c787fb-f6ea-49a0-9b3e-7ce159ace8d2 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:27.746271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 506/1017] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:27.751406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e7f9d-0735-495d-ab8a-7b76a9d8e963 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:27.751839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e7f9d-0735-495d-ab8a-7b76a9d8e963 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:27.751984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e7f9d-0735-495d-ab8a-7b76a9d8e963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:27.769406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a39e7f9d-0735-495d-ab8a-7b76a9d8e963 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:27.770574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a39e7f9d-0735-495d-ab8a-7b76a9d8e963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:27.831147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b224-c085-46b2-9933-f16687babb6a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:27.831450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b224-c085-46b2-9933-f16687babb6a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:27.831742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b224-c085-46b2-9933-f16687babb6a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:27.833277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 507/1018] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:27.834368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:27.838125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fafd0-b787-431c-b327-6046a89d8b9f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:27.838428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fafd0-b787-431c-b327-6046a89d8b9f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:27.838743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fafd0-b787-431c-b327-6046a89d8b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:27.854824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 512/1019] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:27.859834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-294fafd0-b787-431c-b327-6046a89d8b9f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:27.861026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-294fafd0-b787-431c-b327-6046a89d8b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:27.875350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e7f9d-0735-495d-ab8a-7b76a9d8e963 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:27.930618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 508/1020] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:27.953888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fafd0-b787-431c-b327-6046a89d8b9f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:27.981427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e7f9d-0735-495d-ab8a-7b76a9d8e963 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:27.995579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:28.020734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbdb0-4d36-4660-96e8-185aac4d4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:28.021543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbdb0-4d36-4660-96e8-185aac4d4b00 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:28.021833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbdb0-4d36-4660-96e8-185aac4d4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:28.022112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbdb0-4d36-4660-96e8-185aac4d4b00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:28.023337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fbdb0-4d36-4660-96e8-185aac4d4b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:28.024784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fbdb0-4d36-4660-96e8-185aac4d4b00 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:28.030814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 513/1021] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:28.032349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbdb0-4d36-4660-96e8-185aac4d4b00 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:28.078682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fafd0-b787-431c-b327-6046a89d8b9f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:28.100316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:28.114036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:28.114864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:28.115158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:28.115437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] PATH_INFO: `/v3/services/image` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:28.116127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:28.117498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:28.129674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:28.130639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:28.132212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 509/1022] 10.222.0.72 () {56 vars in 1105 bytes} [Tue Jul 12 14:21:27 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:28.136685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:28.149727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbdb0-4d36-4660-96e8-185aac4d4b00 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:28.186184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c79f3f-06e8-4f46-8891-dbcc9153fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:28.186893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c79f3f-06e8-4f46-8891-dbcc9153fe42 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:28.187187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c79f3f-06e8-4f46-8891-dbcc9153fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:28.187471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c79f3f-06e8-4f46-8891-dbcc9153fe42 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:28.188182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c79f3f-06e8-4f46-8891-dbcc9153fe42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:28.189633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c79f3f-06e8-4f46-8891-dbcc9153fe42 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:28.218377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 514/1023] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:21:28 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:28.256003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:28.259201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3967025-b222-4352-9596-ebbfc6c60596 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:28.299263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:28.299922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:28.300213 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:28.300493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:28.301616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] RBAC: Adding query filter params (name=image) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:28.301934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:28.303625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:28.312361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 510/1024] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:28.315603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c79f3f-06e8-4f46-8891-dbcc9153fe42 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:28.424489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c79f3f-06e8-4f46-8891-dbcc9153fe42 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:28.437892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:28.464862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:28.465543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:28.465835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:28.466121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:28.466895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] RBAC: Adding query filter params (type=image) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:28.467213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:28.468621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:28.473759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 515/1025] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:28.479394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:28.579768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462ccd-6e71-44c3-9d13-499aa065e5ae None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:28.612058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dad29d-3b22-49df-948a-fcecac0be204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:28.612722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dad29d-3b22-49df-948a-fcecac0be204 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:28.613006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dad29d-3b22-49df-948a-fcecac0be204 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:28.613282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dad29d-3b22-49df-948a-fcecac0be204 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:28.614066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dad29d-3b22-49df-948a-fcecac0be204 None admin] RBAC: Adding query filter params (interface=public, service_id=b4dea1bb13ca4ebd8d91ac19e2c0484f, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:28.614376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dad29d-3b22-49df-948a-fcecac0be204 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:28.615760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dad29d-3b22-49df-948a-fcecac0be204 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:28.626053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 511/1026] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jul 12 14:21:28 2022] GET /identity/v3/endpoints?service_id=b4dea1bb13ca4ebd8d91ac19e2c0484f&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:28.627327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:28.729747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc120749-6542-47c7-bde6-57067ad2f46b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:28.763908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3095798-c024-484b-af26-488e0a79a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:28.764694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095798-c024-484b-af26-488e0a79a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:28.764880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095798-c024-484b-af26-488e0a79a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:28.765163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095798-c024-484b-af26-488e0a79a2d3 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:28.765845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3095798-c024-484b-af26-488e0a79a2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:28.767543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3095798-c024-484b-af26-488e0a79a2d3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:28.783179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 516/1027] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:21:28 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:21:29.269374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75699-4838-41bc-986c-b56c8c0bcd12 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.269882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75699-4838-41bc-986c-b56c8c0bcd12 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.269959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75699-4838-41bc-986c-b56c8c0bcd12 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.271395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 512/1028] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:29.276903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda4bd-ca37-4e2e-b224-5cdbad226876 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.277202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda4bd-ca37-4e2e-b224-5cdbad226876 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.277487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda4bd-ca37-4e2e-b224-5cdbad226876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.294918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ebeda4bd-ca37-4e2e-b224-5cdbad226876 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:29.296105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ebeda4bd-ca37-4e2e-b224-5cdbad226876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:29.329639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:29.364279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 517/1029] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:29.387311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75699-4838-41bc-986c-b56c8c0bcd12 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:29.420037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:29.503230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75699-4838-41bc-986c-b56c8c0bcd12 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:29.537607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50fd3c-2f9f-4406-acaf-5d0ed781e38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:29.538427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50fd3c-2f9f-4406-acaf-5d0ed781e38f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.538714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50fd3c-2f9f-4406-acaf-5d0ed781e38f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.539019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50fd3c-2f9f-4406-acaf-5d0ed781e38f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.548900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50fd3c-2f9f-4406-acaf-5d0ed781e38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5f50fd3c-2f9f-4406-acaf-5d0ed781e38f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:29.557112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:29.558064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:29.558934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 513/1030] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jul 12 14:21:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:29.564195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeda4bd-ca37-4e2e-b224-5cdbad226876 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:29.664182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeda4bd-ca37-4e2e-b224-5cdbad226876 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:29.697132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:29.698294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.698585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.698888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.699638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:29.699949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:29.701324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:29.709365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 518/1031] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jul 12 14:21:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:29.715361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50fd3c-2f9f-4406-acaf-5d0ed781e38f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:29.801271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:29.815558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50fd3c-2f9f-4406-acaf-5d0ed781e38f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:29.850306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:29.851142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.851432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.851713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.863120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:29.864568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:29.882017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:29.883244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:29.884113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:29.884113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:29.884113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:29.884113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:29.884749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 514/1032] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:29.889496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:29.922228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:29.995953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e77b8-dc23-45f9-9ca1-536f72ecd9f2 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.030097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.030762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.031075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.031350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.032094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:30.032400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.033767 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.048890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 519/1033] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:30.054206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.157516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eff1b6-4d2f-4aa2-8662-a45c90767f93 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.190691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d735f-5ba7-4b93-acf6-25a40b36e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.191442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d735f-5ba7-4b93-acf6-25a40b36e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.191729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d735f-5ba7-4b93-acf6-25a40b36e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.192006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d735f-5ba7-4b93-acf6-25a40b36e9a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.199937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d735f-5ba7-4b93-acf6-25a40b36e9a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.201368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d735f-5ba7-4b93-acf6-25a40b36e9a8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.203852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0a7d735f-5ba7-4b93-acf6-25a40b36e9a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:30.217609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:30.218561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:30.219900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:30.222842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 515/1034] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:30.224588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.306019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748d33-47f3-417b-8c8e-140fa9c90bb9 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.306570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748d33-47f3-417b-8c8e-140fa9c90bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.306674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748d33-47f3-417b-8c8e-140fa9c90bb9 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.308691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 516/1035] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:30.313473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447c11-fd51-4e9c-86c4-c68a85b285a4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.313777 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447c11-fd51-4e9c-86c4-c68a85b285a4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.314068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447c11-fd51-4e9c-86c4-c68a85b285a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.320931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.331065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7c447c11-fd51-4e9c-86c4-c68a85b285a4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:30.332252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7c447c11-fd51-4e9c-86c4-c68a85b285a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:30.334543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2181e-75c4-4dc6-8dfb-b428e2485b63 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.370381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.371103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.371394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.371671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.372516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:30.372832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.374287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.392751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 520/1036] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:30.398095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.405209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 517/1037] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:30.429469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447c11-fd51-4e9c-86c4-c68a85b285a4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.502551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b447ca-b71d-4ed6-927f-dbe8902c7aea None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.538754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447c11-fd51-4e9c-86c4-c68a85b285a4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.540819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea328b-ce19-41ae-b831-a94ad5b7871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.542729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea328b-ce19-41ae-b831-a94ad5b7871a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.543057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea328b-ce19-41ae-b831-a94ad5b7871a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.543345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea328b-ce19-41ae-b831-a94ad5b7871a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.562957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.570728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.577394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e921a8-8e7e-40d3-940f-e5ac6c0ea8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.578195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e921a8-8e7e-40d3-940f-e5ac6c0ea8ac None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.578480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e921a8-8e7e-40d3-940f-e5ac6c0ea8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.578753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e921a8-8e7e-40d3-940f-e5ac6c0ea8ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.579954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e921a8-8e7e-40d3-940f-e5ac6c0ea8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.581387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e921a8-8e7e-40d3-940f-e5ac6c0ea8ac None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.583210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 518/1038] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:30.589002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e921a8-8e7e-40d3-940f-e5ac6c0ea8ac None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.617237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea328b-ce19-41ae-b831-a94ad5b7871a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.618705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea328b-ce19-41ae-b831-a94ad5b7871a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.695706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e921a8-8e7e-40d3-940f-e5ac6c0ea8ac None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.721814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 521/1039] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 14:21:30.727213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea328b-ce19-41ae-b831-a94ad5b7871a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.733846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed800dbd-341c-4d1d-9a27-b87f53386123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.734848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800dbd-341c-4d1d-9a27-b87f53386123 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.735753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800dbd-341c-4d1d-9a27-b87f53386123 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.736247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800dbd-341c-4d1d-9a27-b87f53386123 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.737503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed800dbd-341c-4d1d-9a27-b87f53386123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.739914 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed800dbd-341c-4d1d-9a27-b87f53386123 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.764742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 519/1040] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:30 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:30.783594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.844042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea328b-ce19-41ae-b831-a94ad5b7871a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.878148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf25a5-a78e-4503-ade4-ff0133abd5d9 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.878848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf25a5-a78e-4503-ade4-ff0133abd5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.879427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf25a5-a78e-4503-ade4-ff0133abd5d9 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.881462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 520/1041] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:30.881808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.882995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.883287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.883570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.887616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed11a8-0d25-46a6-9132-c0ac48345aee None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.888182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed11a8-0d25-46a6-9132-c0ac48345aee None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.888718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed11a8-0d25-46a6-9132-c0ac48345aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.895882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.898298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.909040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-10ed11a8-0d25-46a6-9132-c0ac48345aee None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:30.910302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-10ed11a8-0d25-46a6-9132-c0ac48345aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:30.919280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:30.920219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:30.921118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:30.921118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:30.921118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:30.921118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:30.921118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 522/1042] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:30.926273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.973698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.995118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 521/1043] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:31.018291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed11a8-0d25-46a6-9132-c0ac48345aee None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.046765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9795d-7a69-4f51-9bba-ff94979cae66 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.048776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:31.087485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.088171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.089005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.089293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.090023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:31.090332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.091752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.105578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 523/1044] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:31.111061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.123457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed11a8-0d25-46a6-9132-c0ac48345aee None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.160739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.161545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.161833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.162113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] PATH_INFO: `/v3/services/image` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.162763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.164142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:31.175538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:31.176720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:31.179865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 522/1045] 10.222.0.72 () {56 vars in 1105 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:31.182447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.223615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246708-46a8-4828-bbbf-e8223ea8902e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.230413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:31.261246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.262053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.262340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.262621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.269475 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.270907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.283740 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14a26-0d78-41fc-8cc6-98b8ec185e20 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:31.285947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:31.287009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:31.287924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 524/1046] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:31.292830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.317764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:31.322413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.323914 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.324184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.324468 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.325181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] RBAC: Adding query filter params (name=image) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:31.325494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.326890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.336609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 523/1047] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:31.337642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.402065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0917d-9c32-4c3b-b593-e8e6e1f93c63 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.436596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1683d-51c0-4d61-9e4e-8438ca0e1329 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.438527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.439350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.439640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.439918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.440712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:31.441025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.442470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.450675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:31.457632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 525/1048] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:31.463346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.472396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.473068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.473356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.473630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.474341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] RBAC: Adding query filter params (type=image) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:31.474645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.476021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.485499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 524/1049] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:31.486414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.553620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:31.580224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6265-240a-4108-8b5a-711f7fa107e9 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.593034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6c542-b376-42d1-8717-8d34d287fd52 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.617546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1383-4b8a-459e-90b4-962a022c19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.618212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1383-4b8a-459e-90b4-962a022c19c1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.618500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1383-4b8a-459e-90b4-962a022c19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.618793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1383-4b8a-459e-90b4-962a022c19c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.620150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1383-4b8a-459e-90b4-962a022c19c1 None admin] RBAC: Adding query filter params (role.id=ab280a3ac3d2432ca85d4f2bf884c19c, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=7926b212faa44c228ff4ad9e63ee0287) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:31.620469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1383-4b8a-459e-90b4-962a022c19c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.621911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1383-4b8a-459e-90b4-962a022c19c1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.638798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 526/1050] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/role_assignments?user.id=7926b212faa44c228ff4ad9e63ee0287&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=ab280a3ac3d2432ca85d4f2bf884c19c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:31.639016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb41e8-baf4-489e-8f34-cb0b421a9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.639016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb41e8-baf4-489e-8f34-cb0b421a9819 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.639016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb41e8-baf4-489e-8f34-cb0b421a9819 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.639016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb41e8-baf4-489e-8f34-cb0b421a9819 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.639371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb41e8-baf4-489e-8f34-cb0b421a9819 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.639371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb41e8-baf4-489e-8f34-cb0b421a9819 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.658560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 525/1051] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:21:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:32.855243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b200a0-b904-4376-8556-d1a367473fa2 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:32.855765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b200a0-b904-4376-8556-d1a367473fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:32.855868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b200a0-b904-4376-8556-d1a367473fa2 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:32.857232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 527/1052] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:32.862480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290f3d2-3dca-442e-9908-57c05ffd2cd0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:32.862917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290f3d2-3dca-442e-9908-57c05ffd2cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:32.863081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290f3d2-3dca-442e-9908-57c05ffd2cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:32.880329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f290f3d2-3dca-442e-9908-57c05ffd2cd0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:32.881518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f290f3d2-3dca-442e-9908-57c05ffd2cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:32.908529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:32.958591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 526/1053] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:32.981837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b200a0-b904-4376-8556-d1a367473fa2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.089476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b200a0-b904-4376-8556-d1a367473fa2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.124206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013bc6e-dbd8-49d8-8826-7d4066d9bcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.125259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013bc6e-dbd8-49d8-8826-7d4066d9bcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.125698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013bc6e-dbd8-49d8-8826-7d4066d9bcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.126127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013bc6e-dbd8-49d8-8826-7d4066d9bcd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.137065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013bc6e-dbd8-49d8-8826-7d4066d9bcd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-a013bc6e-dbd8-49d8-8826-7d4066d9bcd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:33.145094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:33.146132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:33.147012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:33.152952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 528/1054] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:33.154686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290f3d2-3dca-442e-9908-57c05ffd2cd0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.254461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290f3d2-3dca-442e-9908-57c05ffd2cd0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.288744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.289744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.290243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.290706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.292215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:33.292709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:33.294250 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:33.307634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 527/1055] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:33.309776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013bc6e-dbd8-49d8-8826-7d4066d9bcd0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.319473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.412909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013bc6e-dbd8-49d8-8826-7d4066d9bcd0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.447952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ddd1f-71e8-425e-89b6-270709452e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.449179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddd1f-71e8-425e-89b6-270709452e50 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.449653 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddd1f-71e8-425e-89b6-270709452e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.450119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddd1f-71e8-425e-89b6-270709452e50 None admin] PATH_INFO: `/v3/users/512a36e8d18d4ede972d5b373d47096f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.463986 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ddd1f-71e8-425e-89b6-270709452e50 None admin] RBAC: Authorizing `identity:get_user(user_id=512a36e8d18d4ede972d5b373d47096f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:33.465670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ddd1f-71e8-425e-89b6-270709452e50 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:33.472368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 529/1056] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/users/512a36e8d18d4ede972d5b373d47096f => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:33.473896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.498650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.580129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be7a4c-e935-423b-8bc4-e653ce0d6b55 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.613999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1bc1-badb-4e47-b57e-3e9155be0ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.614666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1bc1-badb-4e47-b57e-3e9155be0ccb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.614979 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1bc1-badb-4e47-b57e-3e9155be0ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.615259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1bc1-badb-4e47-b57e-3e9155be0ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.649856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93e65-6a04-418e-b77b-9d72634b47de None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.650152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93e65-6a04-418e-b77b-9d72634b47de None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.650432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93e65-6a04-418e-b77b-9d72634b47de None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.652742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 530/1057] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:33.657487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c6a9-c309-41dc-8482-e4e7439c94e6 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.657773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c6a9-c309-41dc-8482-e4e7439c94e6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.658055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60c6a9-c309-41dc-8482-e4e7439c94e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.675013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-6c60c6a9-c309-41dc-8482-e4e7439c94e6 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:33.676133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6c60c6a9-c309-41dc-8482-e4e7439c94e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:33.688610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a1bc1-badb-4e47-b57e-3e9155be0ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:33.690072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a1bc1-badb-4e47-b57e-3e9155be0ccb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:33.710519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.735154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.744707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 531/1058] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:33.745998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48432-fca0-485c-9806-4aacf75b4cc6 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.746291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48432-fca0-485c-9806-4aacf75b4cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.746591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48432-fca0-485c-9806-4aacf75b4cc6 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.747862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 532/1059] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:33.752938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981763b-f56c-42ff-83be-cc77dd2c4eae None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.753235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981763b-f56c-42ff-83be-cc77dd2c4eae None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.753512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981763b-f56c-42ff-83be-cc77dd2c4eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.769452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-8981763b-f56c-42ff-83be-cc77dd2c4eae None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:33.770641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8981763b-f56c-42ff-83be-cc77dd2c4eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:33.794436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 528/1060] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:33.799853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1bc1-badb-4e47-b57e-3e9155be0ccb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.835684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 533/1061] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:33.847015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981763b-f56c-42ff-83be-cc77dd2c4eae None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.904899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1bc1-badb-4e47-b57e-3e9155be0ccb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.924572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.937434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981763b-f56c-42ff-83be-cc77dd2c4eae None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.938918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcad432-6799-43d8-aeb3-f481d93cdfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.939729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcad432-6799-43d8-aeb3-f481d93cdfbf None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.940016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcad432-6799-43d8-aeb3-f481d93cdfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.940294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcad432-6799-43d8-aeb3-f481d93cdfbf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.950205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcad432-6799-43d8-aeb3-f481d93cdfbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4fcad432-6799-43d8-aeb3-f481d93cdfbf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:33.958305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:33.959234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:33.960066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 529/1062] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:33.960739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.960809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcad432-6799-43d8-aeb3-f481d93cdfbf None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.976065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3705-a0a7-4b64-8dce-e869e6a2c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.976935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3705-a0a7-4b64-8dce-e869e6a2c660 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.977218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3705-a0a7-4b64-8dce-e869e6a2c660 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.977497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3705-a0a7-4b64-8dce-e869e6a2c660 None admin] PATH_INFO: `/v3/projects/6ba954cf076c4d2d9b4dff21efea507b` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.979292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3705-a0a7-4b64-8dce-e869e6a2c660 None admin] RBAC: Authorizing `identity:get_project(project_id=6ba954cf076c4d2d9b4dff21efea507b)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:33.980744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3705-a0a7-4b64-8dce-e869e6a2c660 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:33.982431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 534/1063] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/projects/6ba954cf076c4d2d9b4dff21efea507b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:33.983207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3705-a0a7-4b64-8dce-e869e6a2c660 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.064463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcad432-6799-43d8-aeb3-f481d93cdfbf None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.082306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3705-a0a7-4b64-8dce-e869e6a2c660 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.098442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6408-0b6f-4cd8-ac00-e0a0fefa83f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.099139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6408-0b6f-4cd8-ac00-e0a0fefa83f2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.099431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6408-0b6f-4cd8-ac00-e0a0fefa83f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.099718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6408-0b6f-4cd8-ac00-e0a0fefa83f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.114887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.115555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.115840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.116115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.116858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.117165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.118525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.126454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 535/1064] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:34.127091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.148603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.170225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6408-0b6f-4cd8-ac00-e0a0fefa83f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.171711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6408-0b6f-4cd8-ac00-e0a0fefa83f2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.181842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.227612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bbb8e-60c5-4383-b947-21015c3b8074 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.261582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.262235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.262529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.262831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.263665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=6ba954cf076c4d2d9b4dff21efea507b, user.id=512a36e8d18d4ede972d5b373d47096f) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.263984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.265421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.268099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 530/1065] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:34.269004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6408-0b6f-4cd8-ac00-e0a0fefa83f2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.279812 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 536/1066] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/role_assignments?user.id=512a36e8d18d4ede972d5b373d47096f&scope.project.id=6ba954cf076c4d2d9b4dff21efea507b&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:34.279812 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.374752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.391332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aee2f-9b56-4488-8f14-8eed53e48da5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.398371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6408-0b6f-4cd8-ac00-e0a0fefa83f2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.410961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.429757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.430658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.430988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.431271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.442512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.443994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.448570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.449568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.449996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.450414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:34.461669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:34.462760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:34.468528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:34.468528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:34.468528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:34.468528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:34.468766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.468842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 537/1067] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:34.468907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.468973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:34.482924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:34.483781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:34.484726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:34.484726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:34.484726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:34.484726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:34.484726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 531/1068] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:34.489623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.581326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa82d9-9b3f-4f1d-9085-db3a64f67a30 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.591282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc396404-4665-4bc2-bccc-a6535a17b303 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.619989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.620768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.620950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.621229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.622073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.622247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.622678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.623993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.628059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.629105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.629654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.629935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.631002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.631315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.632663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.637376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 538/1069] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:34.650017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 532/1070] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:34.651678 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.685986 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.764778 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1080b7-0cdb-4c59-bb98-b3b21210ca3a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.802530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.803755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.804124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.804406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.812255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.813728 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:34.829255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:34.830202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:34.831576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 539/1071] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:34.837023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.946293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b974f-38ae-4ad2-bca8-111931a79c4b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.978301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.979520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.979805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.980080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.980914 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.981223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.982632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.999832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 533/1072] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:35.005315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.098072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.108661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e26927-98f5-4c3e-ae7d-07edd74033ed None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.140449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.141233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.141517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.141792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.152090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.153526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:35.170793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:35.171821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:35.172907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:35.172907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:35.172907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:35.172907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:35.174908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 540/1073] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:35.177597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.225563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.273493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f4531-e948-4a73-84f6-82de2aa66082 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.306615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.307326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.307614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.307893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.308606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:35.308913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.310627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.321895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 534/1074] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:35.327256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.426906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e8b7-b66c-42b6-920d-b6fd0ba94bf2 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.459639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.460434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.460716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.461001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.468028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.469468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:35.483431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:35.484454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:35.485393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 541/1075] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:35.490295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.586134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b0f5e-8261-4f25-8554-29b6a8237538 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.596512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.618991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1d0ff-009c-43e0-8711-b1cc9973ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.619676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d0ff-009c-43e0-8711-b1cc9973ca39 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.619962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d0ff-009c-43e0-8711-b1cc9973ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.620243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d0ff-009c-43e0-8711-b1cc9973ca39 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.621023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1d0ff-009c-43e0-8711-b1cc9973ca39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:35.621332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1d0ff-009c-43e0-8711-b1cc9973ca39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.622789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1d0ff-009c-43e0-8711-b1cc9973ca39 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.635507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 535/1076] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:35.641201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.644051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.740854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94bea5-33b6-4da7-9a14-196e19a2f5f5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.774270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607228d-2750-4012-899b-c1efecaec4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.775200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607228d-2750-4012-899b-c1efecaec4a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.776058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607228d-2750-4012-899b-c1efecaec4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.776343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607228d-2750-4012-899b-c1efecaec4a4 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/7926b212faa44c228ff4ad9e63ee0287/roles/ab280a3ac3d2432ca85d4f2bf884c19c` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.778550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607228d-2750-4012-899b-c1efecaec4a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=7926b212faa44c228ff4ad9e63ee0287, role_id=ab280a3ac3d2432ca85d4f2bf884c19c)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.780038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607228d-2750-4012-899b-c1efecaec4a4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.792867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 542/1077] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:35 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/7926b212faa44c228ff4ad9e63ee0287/roles/ab280a3ac3d2432ca85d4f2bf884c19c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:21:36.284988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561cbd5-f509-43ed-97e6-f8598f21f987 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.285610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561cbd5-f509-43ed-97e6-f8598f21f987 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.285610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561cbd5-f509-43ed-97e6-f8598f21f987 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.286942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 536/1078] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:36.292722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d67c-af06-4a21-bafb-11a3314cb49e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.293108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d67c-af06-4a21-bafb-11a3314cb49e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.293356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d67c-af06-4a21-bafb-11a3314cb49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.310496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-6c13d67c-af06-4a21-bafb-11a3314cb49e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:36.311720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6c13d67c-af06-4a21-bafb-11a3314cb49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:36.365264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.376794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 543/1079] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:36.399006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561cbd5-f509-43ed-97e6-f8598f21f987 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.500026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561cbd5-f509-43ed-97e6-f8598f21f987 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.532982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da13c16-c774-489b-b010-788d6a2ab517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.533773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da13c16-c774-489b-b010-788d6a2ab517 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.534063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da13c16-c774-489b-b010-788d6a2ab517 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.534339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da13c16-c774-489b-b010-788d6a2ab517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.544773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da13c16-c774-489b-b010-788d6a2ab517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9da13c16-c774-489b-b010-788d6a2ab517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:36.552545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:36.553584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:36.554459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 537/1080] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:36.560577 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d67c-af06-4a21-bafb-11a3314cb49e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.656538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d67c-af06-4a21-bafb-11a3314cb49e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.690022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.690686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.691005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.691290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.692036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:36.692346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.693726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.701606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 544/1081] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:36.707301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da13c16-c774-489b-b010-788d6a2ab517 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.738215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.806104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da13c16-c774-489b-b010-788d6a2ab517 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.839953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bb3f2-6c97-4a67-a878-69dff00f9de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.840883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bb3f2-6c97-4a67-a878-69dff00f9de6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.841172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bb3f2-6c97-4a67-a878-69dff00f9de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.841451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bb3f2-6c97-4a67-a878-69dff00f9de6 None admin] PATH_INFO: `/v3/users/512a36e8d18d4ede972d5b373d47096f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.842632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bb3f2-6c97-4a67-a878-69dff00f9de6 None admin] RBAC: Authorizing `identity:get_user(user_id=512a36e8d18d4ede972d5b373d47096f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.844162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bb3f2-6c97-4a67-a878-69dff00f9de6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.845795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 538/1082] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/users/512a36e8d18d4ede972d5b373d47096f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:36.851616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.909551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.952904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e7e5e-96af-47d3-aa23-2735fc5f2108 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.985503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf0dc1-2dcb-4e21-b4cf-43df21e9f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.986368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf0dc1-2dcb-4e21-b4cf-43df21e9f505 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.986681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf0dc1-2dcb-4e21-b4cf-43df21e9f505 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.986997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf0dc1-2dcb-4e21-b4cf-43df21e9f505 None admin] PATH_INFO: `/v3/projects/6ba954cf076c4d2d9b4dff21efea507b` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.988173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf0dc1-2dcb-4e21-b4cf-43df21e9f505 None admin] RBAC: Authorizing `identity:get_project(project_id=6ba954cf076c4d2d9b4dff21efea507b)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.989611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf0dc1-2dcb-4e21-b4cf-43df21e9f505 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.991318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 545/1083] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/projects/6ba954cf076c4d2d9b4dff21efea507b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:36.998380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bb3f2-6c97-4a67-a878-69dff00f9de6 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.098080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:37.102195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bb3f2-6c97-4a67-a878-69dff00f9de6 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.135150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadbc8c-c3e7-424c-b2a8-60943f2940d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.136057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadbc8c-c3e7-424c-b2a8-60943f2940d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.136346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadbc8c-c3e7-424c-b2a8-60943f2940d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.136628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadbc8c-c3e7-424c-b2a8-60943f2940d0 None admin] PATH_INFO: `/v3/projects/6ba954cf076c4d2d9b4dff21efea507b/users/512a36e8d18d4ede972d5b373d47096f/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.138647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadbc8c-c3e7-424c-b2a8-60943f2940d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ba954cf076c4d2d9b4dff21efea507b, user_id=512a36e8d18d4ede972d5b373d47096f, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.140114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadbc8c-c3e7-424c-b2a8-60943f2940d0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.153425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 539/1084] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:36 2022] PUT /identity/v3/projects/6ba954cf076c4d2d9b4dff21efea507b/users/512a36e8d18d4ede972d5b373d47096f/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:37.786757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837daf-0546-4b7c-917d-fee249acd5a1 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.787369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837daf-0546-4b7c-917d-fee249acd5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.787369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837daf-0546-4b7c-917d-fee249acd5a1 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.788702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 546/1085] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:37.794186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a64e20-7c10-4be3-9900-bff49f3c4451 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.794620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a64e20-7c10-4be3-9900-bff49f3c4451 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.794792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a64e20-7c10-4be3-9900-bff49f3c4451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.812016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-58a64e20-7c10-4be3-9900-bff49f3c4451 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:37.813215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-58a64e20-7c10-4be3-9900-bff49f3c4451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:37.879901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 540/1086] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:37.903506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837daf-0546-4b7c-917d-fee249acd5a1 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.003948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837daf-0546-4b7c-917d-fee249acd5a1 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.026270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.037855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051ab7-dd35-4f9d-a455-6331ea78e36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.038619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051ab7-dd35-4f9d-a455-6331ea78e36d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.038949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051ab7-dd35-4f9d-a455-6331ea78e36d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.039263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051ab7-dd35-4f9d-a455-6331ea78e36d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.049933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2051ab7-dd35-4f9d-a455-6331ea78e36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-e2051ab7-dd35-4f9d-a455-6331ea78e36d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:38.058850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:38.059755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:21:38.060578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:38.063211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 547/1087] 10.222.0.72 () {56 vars in 1120 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:38.066098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a64e20-7c10-4be3-9900-bff49f3c4451 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.151136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.163734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a64e20-7c10-4be3-9900-bff49f3c4451 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.197656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.198334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.198626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.198955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.199713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:38.200027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.201394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.209608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 541/1088] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:38.215638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051ab7-dd35-4f9d-a455-6331ea78e36d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.315122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051ab7-dd35-4f9d-a455-6331ea78e36d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.347219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.348015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.348305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.348587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.359372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.360835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:38.377472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:38.378505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:38.379434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:38.379434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:38.379434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:38.379434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:38.379434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 548/1089] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:38.384438 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.482058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc124c85-783f-4fd6-b7db-6125b3e5126d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.514317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.515005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.515299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.515582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.516302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:38.516612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.517970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.530241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 542/1090] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:38.535658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.569331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.633687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0711c-bef9-4f2d-8011-e4016fa0229e None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.666895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.667694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.667978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.668254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.675509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.676944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:38.690463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:38.691527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:38.692434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 549/1091] 10.222.0.72 () {56 vars in 1093 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:38.697808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.709802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.794541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd3ce-b215-4d56-9cbf-29873abbeaa8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.827132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef201f99-1e78-4b2a-ba18-941da947d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.827737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef201f99-1e78-4b2a-ba18-941da947d36f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.828023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef201f99-1e78-4b2a-ba18-941da947d36f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.828300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef201f99-1e78-4b2a-ba18-941da947d36f None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.829126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef201f99-1e78-4b2a-ba18-941da947d36f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:38.829434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef201f99-1e78-4b2a-ba18-941da947d36f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.830868 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef201f99-1e78-4b2a-ba18-941da947d36f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.848864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 543/1092] 10.222.0.72 () {56 vars in 1133 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:38.854393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.947956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.955146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c365c-46af-44f5-8e10-c2b0db811d1a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.987326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274da1a-471f-4301-9846-b7eddedc0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.987978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274da1a-471f-4301-9846-b7eddedc0183 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.988268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274da1a-471f-4301-9846-b7eddedc0183 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.988550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274da1a-471f-4301-9846-b7eddedc0183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.053770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274da1a-471f-4301-9846-b7eddedc0183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.055267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274da1a-471f-4301-9846-b7eddedc0183 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.144364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.151228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1df0-3ea3-4560-a1a5-5ef70a960dca None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.151603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1df0-3ea3-4560-a1a5-5ef70a960dca None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.151960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1df0-3ea3-4560-a1a5-5ef70a960dca None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.156972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 550/1093] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:39.157096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 544/1094] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:39.158028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274da1a-471f-4301-9846-b7eddedc0183 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.158282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68c15-518c-4524-8281-7cbcd557b2b6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.158576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68c15-518c-4524-8281-7cbcd557b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.158991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf68c15-518c-4524-8281-7cbcd557b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.175029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5bf68c15-518c-4524-8281-7cbcd557b2b6 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:39.176232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5bf68c15-518c-4524-8281-7cbcd557b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:39.237000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.243221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 545/1095] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:21:39.256337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274da1a-471f-4301-9846-b7eddedc0183 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.266982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf68c15-518c-4524-8281-7cbcd557b2b6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.289417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.290213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.290499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.291290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.301203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.302646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:39.320479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:39.321373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:39.322254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:39.322254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:39.322254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:39.322254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:39.322254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 551/1096] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:39.327260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.364219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf68c15-518c-4524-8281-7cbcd557b2b6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.372221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.397781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa366-70a9-4782-81b2-78880ae900c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.398568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa366-70a9-4782-81b2-78880ae900c9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.398891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa366-70a9-4782-81b2-78880ae900c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.399172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa366-70a9-4782-81b2-78880ae900c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.409558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaa366-70a9-4782-81b2-78880ae900c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-85eaa366-70a9-4782-81b2-78880ae900c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:39.417765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:39.418690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:21:39.419776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 546/1097] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:39.424791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa366-70a9-4782-81b2-78880ae900c9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.427286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f6b62-2877-4e8d-b04f-afa4f4cdc076 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.461631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.462292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.462598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.462910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.463628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:39.463935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.465346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.476588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 552/1098] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:39.482451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.482581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.524888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa366-70a9-4782-81b2-78880ae900c9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.559173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.559842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.560136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.560421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.561172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:39.561482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.562873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.570829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 547/1099] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:39.576437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.581372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28706a91-6e1b-4266-96c0-182bd62f683f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.588800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.616378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.617175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.617467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.617750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.625042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.626496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:39.640030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:39.641031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:39.641907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 553/1100] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:39.647117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.679819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4110-444d-4dc8-8739-5c75bcefbfa2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.700730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.715461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858380-6cdc-4fe7-a77b-e0f964457e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.716335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858380-6cdc-4fe7-a77b-e0f964457e7d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.716629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858380-6cdc-4fe7-a77b-e0f964457e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.716913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858380-6cdc-4fe7-a77b-e0f964457e7d None admin] PATH_INFO: `/v3/users/512a36e8d18d4ede972d5b373d47096f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.718124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c858380-6cdc-4fe7-a77b-e0f964457e7d None admin] RBAC: Authorizing `identity:get_user(user_id=512a36e8d18d4ede972d5b373d47096f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.719583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c858380-6cdc-4fe7-a77b-e0f964457e7d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.721225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 548/1101] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/users/512a36e8d18d4ede972d5b373d47096f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:39.726749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858380-6cdc-4fe7-a77b-e0f964457e7d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.745157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d1d33-0de8-4670-acb9-5bf9de726738 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.778765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.779591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.779876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.780149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.780930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:39.781241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.782664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.794906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 554/1102] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:39.800895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.824040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858380-6cdc-4fe7-a77b-e0f964457e7d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.826848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.857859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff066ddb-a8f4-49d3-a8f4-d27bb4eeb932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.858507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066ddb-a8f4-49d3-a8f4-d27bb4eeb932 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.858812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066ddb-a8f4-49d3-a8f4-d27bb4eeb932 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.859091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff066ddb-a8f4-49d3-a8f4-d27bb4eeb932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.899848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eb147-eeae-4242-a08b-53883e5d6aa0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.912549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.925786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff066ddb-a8f4-49d3-a8f4-d27bb4eeb932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.927279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff066ddb-a8f4-49d3-a8f4-d27bb4eeb932 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.933677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.934271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.934560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.934879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.935707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] RBAC: Adding query filter params (role.id=ab280a3ac3d2432ca85d4f2bf884c19c, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=7926b212faa44c228ff4ad9e63ee0287) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:39.936020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.937446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.943438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 555/1103] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/role_assignments?user.id=7926b212faa44c228ff4ad9e63ee0287&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=ab280a3ac3d2432ca85d4f2bf884c19c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:40.031705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 549/1104] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 14:21:40.037685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.132395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:40.143689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256007-e165-47c4-b53c-f0dbce0a58aa None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.177650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cc9c2-2474-4b90-97ed-f3c0fb61eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.178524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc9c2-2474-4b90-97ed-f3c0fb61eed4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.178843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc9c2-2474-4b90-97ed-f3c0fb61eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.179129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc9c2-2474-4b90-97ed-f3c0fb61eed4 None admin] PATH_INFO: `/v3/projects/6ba954cf076c4d2d9b4dff21efea507b` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.180316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cc9c2-2474-4b90-97ed-f3c0fb61eed4 None admin] RBAC: Authorizing `identity:get_project(project_id=6ba954cf076c4d2d9b4dff21efea507b)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:40.181804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cc9c2-2474-4b90-97ed-f3c0fb61eed4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:40.183547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 556/1105] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/projects/6ba954cf076c4d2d9b4dff21efea507b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:40.189996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff066ddb-a8f4-49d3-a8f4-d27bb4eeb932 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.279199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:40.292539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff066ddb-a8f4-49d3-a8f4-d27bb4eeb932 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.328371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7f648-bb1b-4c59-9852-339edb5545d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.329038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7f648-bb1b-4c59-9852-339edb5545d7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.329321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7f648-bb1b-4c59-9852-339edb5545d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.329596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7f648-bb1b-4c59-9852-339edb5545d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.330425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7f648-bb1b-4c59-9852-339edb5545d7 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=6ba954cf076c4d2d9b4dff21efea507b, user.id=512a36e8d18d4ede972d5b373d47096f) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:40.330738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7f648-bb1b-4c59-9852-339edb5545d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:40.332208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7f648-bb1b-4c59-9852-339edb5545d7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:40.338579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 550/1106] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/role_assignments?user.id=512a36e8d18d4ede972d5b373d47096f&scope.project.id=6ba954cf076c4d2d9b4dff21efea507b&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:42.374828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22ea9-ddd9-4799-8673-da1c2d9f8e95 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.375325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22ea9-ddd9-4799-8673-da1c2d9f8e95 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.375484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22ea9-ddd9-4799-8673-da1c2d9f8e95 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.376866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 557/1107] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:42.381855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a8a96-0a43-4772-9805-81d67d93408d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.382267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a8a96-0a43-4772-9805-81d67d93408d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.382415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a8a96-0a43-4772-9805-81d67d93408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.399247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a48a8a96-0a43-4772-9805-81d67d93408d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:42.401282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a48a8a96-0a43-4772-9805-81d67d93408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:42.464401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 551/1108] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:42.488481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22ea9-ddd9-4799-8673-da1c2d9f8e95 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.586592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22ea9-ddd9-4799-8673-da1c2d9f8e95 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.619120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa483-2e20-42c4-9652-d1022ac9a746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.619907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa483-2e20-42c4-9652-d1022ac9a746 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.620190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa483-2e20-42c4-9652-d1022ac9a746 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.620464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa483-2e20-42c4-9652-d1022ac9a746 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.621618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa483-2e20-42c4-9652-d1022ac9a746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.623076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa483-2e20-42c4-9652-d1022ac9a746 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.624667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 558/1109] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:42.630298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a8a96-0a43-4772-9805-81d67d93408d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.706964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.724443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a8a96-0a43-4772-9805-81d67d93408d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.757206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9629-40d1-49c8-b438-58b589231d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.757864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9629-40d1-49c8-b438-58b589231d46 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.758175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9629-40d1-49c8-b438-58b589231d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.758458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9629-40d1-49c8-b438-58b589231d46 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.759221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de9629-40d1-49c8-b438-58b589231d46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.761125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de9629-40d1-49c8-b438-58b589231d46 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.781019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 552/1110] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:42 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:44.818364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9780-d042-48f7-82d6-1895d995b578 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.818915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9780-d042-48f7-82d6-1895d995b578 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.819005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9780-d042-48f7-82d6-1895d995b578 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.820335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 559/1111] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:44.825535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd739f01-a8a8-442c-92fe-6e2cb0433a02 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.825937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd739f01-a8a8-442c-92fe-6e2cb0433a02 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.826100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd739f01-a8a8-442c-92fe-6e2cb0433a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.844547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fd739f01-a8a8-442c-92fe-6e2cb0433a02 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:44.846062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fd739f01-a8a8-442c-92fe-6e2cb0433a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:44.910434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 553/1112] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:44.934697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb9780-d042-48f7-82d6-1895d995b578 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.961854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.034190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb9780-d042-48f7-82d6-1895d995b578 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.067339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accba08-a67f-440f-a1cd-0fd85d2c0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.068207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accba08-a67f-440f-a1cd-0fd85d2c0ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.068546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accba08-a67f-440f-a1cd-0fd85d2c0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.068782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accba08-a67f-440f-a1cd-0fd85d2c0ae0 None admin] PATH_INFO: `/v3/roles/69f0d114dbd94de3896c418607fa6e1a` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.070264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accba08-a67f-440f-a1cd-0fd85d2c0ae0 None admin] RBAC: Authorizing `identity:get_role(role_id=69f0d114dbd94de3896c418607fa6e1a)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.071687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accba08-a67f-440f-a1cd-0fd85d2c0ae0 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.073109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 560/1113] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:44 2022] GET /identity/v3/roles/69f0d114dbd94de3896c418607fa6e1a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:45.078857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd739f01-a8a8-442c-92fe-6e2cb0433a02 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.141449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.174792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd739f01-a8a8-442c-92fe-6e2cb0433a02 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.206964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc9875-bf09-4867-839a-6cdff7290112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.207835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc9875-bf09-4867-839a-6cdff7290112 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.208123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc9875-bf09-4867-839a-6cdff7290112 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.208403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc9875-bf09-4867-839a-6cdff7290112 None admin] PATH_INFO: `/v3/users/b831d9a186a0495abaf95b4610a18c5e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.221551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc9875-bf09-4867-839a-6cdff7290112 None admin] RBAC: Authorizing `identity:get_user(user_id=b831d9a186a0495abaf95b4610a18c5e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.223010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc9875-bf09-4867-839a-6cdff7290112 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.224632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 554/1114] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/users/b831d9a186a0495abaf95b4610a18c5e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:45.230857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accba08-a67f-440f-a1cd-0fd85d2c0ae0 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.327100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.334031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accba08-a67f-440f-a1cd-0fd85d2c0ae0 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.366340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32cc1-d291-4359-a2bd-b2e1677a3f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.367017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32cc1-d291-4359-a2bd-b2e1677a3f6c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.367306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32cc1-d291-4359-a2bd-b2e1677a3f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.367582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32cc1-d291-4359-a2bd-b2e1677a3f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.431570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f32cc1-d291-4359-a2bd-b2e1677a3f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.433024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f32cc1-d291-4359-a2bd-b2e1677a3f6c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.519880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.528313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 561/1115] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:45.534175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc9875-bf09-4867-839a-6cdff7290112 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.629540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc9875-bf09-4867-839a-6cdff7290112 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.654433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.663075 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e784bc-a4a4-4113-b3b8-6c7c0a1566bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.663927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e784bc-a4a4-4113-b3b8-6c7c0a1566bb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.664214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e784bc-a4a4-4113-b3b8-6c7c0a1566bb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.664494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e784bc-a4a4-4113-b3b8-6c7c0a1566bb None admin] PATH_INFO: `/v3/projects/6ba954cf076c4d2d9b4dff21efea507b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.665659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e784bc-a4a4-4113-b3b8-6c7c0a1566bb None admin] RBAC: Authorizing `identity:get_project(project_id=6ba954cf076c4d2d9b4dff21efea507b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.667116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e784bc-a4a4-4113-b3b8-6c7c0a1566bb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.668800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 555/1116] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/projects/6ba954cf076c4d2d9b4dff21efea507b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:45.674826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32cc1-d291-4359-a2bd-b2e1677a3f6c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.772219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32cc1-d291-4359-a2bd-b2e1677a3f6c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.804254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97c8d-a83a-4d65-9cb1-2fc60a121003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.804906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97c8d-a83a-4d65-9cb1-2fc60a121003 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.805194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97c8d-a83a-4d65-9cb1-2fc60a121003 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.805475 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97c8d-a83a-4d65-9cb1-2fc60a121003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.806811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b97c8d-a83a-4d65-9cb1-2fc60a121003 None admin] RBAC: Adding query filter params (role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=6ba954cf076c4d2d9b4dff21efea507b, user.id=b831d9a186a0495abaf95b4610a18c5e) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:45.807132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b97c8d-a83a-4d65-9cb1-2fc60a121003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.808566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b97c8d-a83a-4d65-9cb1-2fc60a121003 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.813784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 562/1117] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/role_assignments?user.id=b831d9a186a0495abaf95b4610a18c5e&scope.project.id=6ba954cf076c4d2d9b4dff21efea507b&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:47.779985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b679603-02a0-428c-841c-86265f304816 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.780555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b679603-02a0-428c-841c-86265f304816 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.780555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b679603-02a0-428c-841c-86265f304816 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.781921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 556/1118] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:47.787107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eec03-b22a-425c-a359-ac54b9076b07 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.787523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eec03-b22a-425c-a359-ac54b9076b07 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.787682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eec03-b22a-425c-a359-ac54b9076b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.803917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-424eec03-b22a-425c-a359-ac54b9076b07 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:47.805099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-424eec03-b22a-425c-a359-ac54b9076b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:47.856314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:47.870703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 563/1119] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:47.892893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b679603-02a0-428c-841c-86265f304816 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:47.990966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b679603-02a0-428c-841c-86265f304816 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.024673 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36ad91-4628-4248-a7db-a333cd6df57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.025805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36ad91-4628-4248-a7db-a333cd6df57f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.026092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36ad91-4628-4248-a7db-a333cd6df57f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.026379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36ad91-4628-4248-a7db-a333cd6df57f None admin] PATH_INFO: `/v3/roles/69f0d114dbd94de3896c418607fa6e1a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.027867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36ad91-4628-4248-a7db-a333cd6df57f None admin] RBAC: Authorizing `identity:get_role(role_id=69f0d114dbd94de3896c418607fa6e1a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.029229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36ad91-4628-4248-a7db-a333cd6df57f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.030651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 557/1120] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:47 2022] GET /identity/v3/roles/69f0d114dbd94de3896c418607fa6e1a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:48.036400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eec03-b22a-425c-a359-ac54b9076b07 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.131661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eec03-b22a-425c-a359-ac54b9076b07 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.164840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef5bd-b6e7-4b95-85e4-1a900f069561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.165705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef5bd-b6e7-4b95-85e4-1a900f069561 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.165991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef5bd-b6e7-4b95-85e4-1a900f069561 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.166270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef5bd-b6e7-4b95-85e4-1a900f069561 None admin] PATH_INFO: `/v3/users/b831d9a186a0495abaf95b4610a18c5e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.167455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ef5bd-b6e7-4b95-85e4-1a900f069561 None admin] RBAC: Authorizing `identity:get_user(user_id=b831d9a186a0495abaf95b4610a18c5e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.168881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ef5bd-b6e7-4b95-85e4-1a900f069561 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.170484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 564/1121] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/users/b831d9a186a0495abaf95b4610a18c5e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:48.176433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36ad91-4628-4248-a7db-a333cd6df57f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.236372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.280479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36ad91-4628-4248-a7db-a333cd6df57f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.313904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29b0de-2674-4d8e-961e-1876d4f53d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.314694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b0de-2674-4d8e-961e-1876d4f53d74 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.315011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b0de-2674-4d8e-961e-1876d4f53d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.315290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b0de-2674-4d8e-961e-1876d4f53d74 None admin] PATH_INFO: `/v3/projects/6ba954cf076c4d2d9b4dff21efea507b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.316443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29b0de-2674-4d8e-961e-1876d4f53d74 None admin] RBAC: Authorizing `identity:get_project(project_id=6ba954cf076c4d2d9b4dff21efea507b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.317868 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29b0de-2674-4d8e-961e-1876d4f53d74 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.319579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 558/1122] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/projects/6ba954cf076c4d2d9b4dff21efea507b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:48.326163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef5bd-b6e7-4b95-85e4-1a900f069561 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.379030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.421045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef5bd-b6e7-4b95-85e4-1a900f069561 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.453699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab31b7-f06f-4697-a6fc-f2f676128b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.454576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab31b7-f06f-4697-a6fc-f2f676128b75 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.454887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab31b7-f06f-4697-a6fc-f2f676128b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.455165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab31b7-f06f-4697-a6fc-f2f676128b75 None admin] PATH_INFO: `/v3/projects/6ba954cf076c4d2d9b4dff21efea507b/users/b831d9a186a0495abaf95b4610a18c5e/roles/69f0d114dbd94de3896c418607fa6e1a` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.457290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab31b7-f06f-4697-a6fc-f2f676128b75 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ba954cf076c4d2d9b4dff21efea507b, user_id=b831d9a186a0495abaf95b4610a18c5e, role_id=69f0d114dbd94de3896c418607fa6e1a)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.458821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab31b7-f06f-4697-a6fc-f2f676128b75 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.471456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 565/1123] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:48 2022] PUT /identity/v3/projects/6ba954cf076c4d2d9b4dff21efea507b/users/b831d9a186a0495abaf95b4610a18c5e/roles/69f0d114dbd94de3896c418607fa6e1a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:50.444871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fa36-23b7-48d2-9926-fb1464cfd75b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.445445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fa36-23b7-48d2-9926-fb1464cfd75b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.445445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fa36-23b7-48d2-9926-fb1464cfd75b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.447460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 559/1124] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:50.452422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab516624-8481-4c0b-ac25-aeb0a8240733 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.452833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab516624-8481-4c0b-ac25-aeb0a8240733 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.452992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab516624-8481-4c0b-ac25-aeb0a8240733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.469135 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ab516624-8481-4c0b-ac25-aeb0a8240733 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:50.470303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ab516624-8481-4c0b-ac25-aeb0a8240733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:50.534793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 566/1125] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:50.558764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70fa36-23b7-48d2-9926-fb1464cfd75b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.655905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70fa36-23b7-48d2-9926-fb1464cfd75b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.684155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.690196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bd1d2-0826-41dd-a0ca-ad2750ce2544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.691085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bd1d2-0826-41dd-a0ca-ad2750ce2544 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.691379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bd1d2-0826-41dd-a0ca-ad2750ce2544 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.691663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bd1d2-0826-41dd-a0ca-ad2750ce2544 None admin] PATH_INFO: `/v3/roles/69f0d114dbd94de3896c418607fa6e1a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.693142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bd1d2-0826-41dd-a0ca-ad2750ce2544 None admin] RBAC: Authorizing `identity:get_role(role_id=69f0d114dbd94de3896c418607fa6e1a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.694510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bd1d2-0826-41dd-a0ca-ad2750ce2544 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.695989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 560/1126] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/roles/69f0d114dbd94de3896c418607fa6e1a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:50.701590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab516624-8481-4c0b-ac25-aeb0a8240733 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.746305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.802062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab516624-8481-4c0b-ac25-aeb0a8240733 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.836382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ff09-062e-4718-a702-2a4c175fc091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.837819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ff09-062e-4718-a702-2a4c175fc091 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.838143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ff09-062e-4718-a702-2a4c175fc091 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.838389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ff09-062e-4718-a702-2a4c175fc091 None admin] PATH_INFO: `/v3/users/b831d9a186a0495abaf95b4610a18c5e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.839612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13ff09-062e-4718-a702-2a4c175fc091 None admin] RBAC: Authorizing `identity:get_user(user_id=b831d9a186a0495abaf95b4610a18c5e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.841060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13ff09-062e-4718-a702-2a4c175fc091 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.842820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 567/1127] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/users/b831d9a186a0495abaf95b4610a18c5e => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:50.848487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bd1d2-0826-41dd-a0ca-ad2750ce2544 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.951454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bd1d2-0826-41dd-a0ca-ad2750ce2544 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.986092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47d00b-1442-4932-a05f-6c5584b6b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.986755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47d00b-1442-4932-a05f-6c5584b6b78b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.987072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47d00b-1442-4932-a05f-6c5584b6b78b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.987355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47d00b-1442-4932-a05f-6c5584b6b78b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.050042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.053929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47d00b-1442-4932-a05f-6c5584b6b78b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.055533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47d00b-1442-4932-a05f-6c5584b6b78b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.150953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 561/1128] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:51.156774 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ff09-062e-4718-a702-2a4c175fc091 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.252463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ff09-062e-4718-a702-2a4c175fc091 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.266384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.287021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053648bc-fe05-43a1-a023-e638c882cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.287883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053648bc-fe05-43a1-a023-e638c882cb13 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.288169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053648bc-fe05-43a1-a023-e638c882cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.288446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053648bc-fe05-43a1-a023-e638c882cb13 None admin] PATH_INFO: `/v3/projects/6ba954cf076c4d2d9b4dff21efea507b` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.289607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053648bc-fe05-43a1-a023-e638c882cb13 None admin] RBAC: Authorizing `identity:get_project(project_id=6ba954cf076c4d2d9b4dff21efea507b)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.291139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053648bc-fe05-43a1-a023-e638c882cb13 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.292829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 568/1129] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/projects/6ba954cf076c4d2d9b4dff21efea507b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:51.298938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47d00b-1442-4932-a05f-6c5584b6b78b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.391678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.395177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47d00b-1442-4932-a05f-6c5584b6b78b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.428616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e0b1f-b0bc-48f2-a0a5-0f7302b9c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.429266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e0b1f-b0bc-48f2-a0a5-0f7302b9c097 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.429552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e0b1f-b0bc-48f2-a0a5-0f7302b9c097 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.429830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e0b1f-b0bc-48f2-a0a5-0f7302b9c097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.430675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e0b1f-b0bc-48f2-a0a5-0f7302b9c097 None admin] RBAC: Adding query filter params (role.id=69f0d114dbd94de3896c418607fa6e1a, scope.project.id=6ba954cf076c4d2d9b4dff21efea507b, user.id=b831d9a186a0495abaf95b4610a18c5e) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:51.431017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e0b1f-b0bc-48f2-a0a5-0f7302b9c097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.432432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e0b1f-b0bc-48f2-a0a5-0f7302b9c097 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.438028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 562/1130] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/role_assignments?user.id=b831d9a186a0495abaf95b4610a18c5e&scope.project.id=6ba954cf076c4d2d9b4dff21efea507b&role.id=69f0d114dbd94de3896c418607fa6e1a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:53.464834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207d31-387e-437f-a03b-58a67fb7f17a None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.465358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207d31-387e-437f-a03b-58a67fb7f17a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.465450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207d31-387e-437f-a03b-58a67fb7f17a None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.466792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 569/1131] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:53.471821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d364ff-af87-4d4e-9ca2-d3b0539e7068 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.472252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d364ff-af87-4d4e-9ca2-d3b0539e7068 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.472382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d364ff-af87-4d4e-9ca2-d3b0539e7068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.489137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c7d364ff-af87-4d4e-9ca2-d3b0539e7068 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:53.490322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c7d364ff-af87-4d4e-9ca2-d3b0539e7068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:53.553476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 563/1132] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:53.577048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4207d31-387e-437f-a03b-58a67fb7f17a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.674862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4207d31-387e-437f-a03b-58a67fb7f17a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.707658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e035b93-4e6a-47f4-ac9e-8e6c672a1efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.708440 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035b93-4e6a-47f4-ac9e-8e6c672a1efe None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.708731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035b93-4e6a-47f4-ac9e-8e6c672a1efe None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.709014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035b93-4e6a-47f4-ac9e-8e6c672a1efe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.710189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e035b93-4e6a-47f4-ac9e-8e6c672a1efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.712229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e035b93-4e6a-47f4-ac9e-8e6c672a1efe None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.713826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 570/1133] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:53.719388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d364ff-af87-4d4e-9ca2-d3b0539e7068 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.805676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.814991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d364ff-af87-4d4e-9ca2-d3b0539e7068 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.848550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae48152-0c6f-4dea-b706-8d7aa9ebf406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.849202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48152-0c6f-4dea-b706-8d7aa9ebf406 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.849527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48152-0c6f-4dea-b706-8d7aa9ebf406 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.849806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae48152-0c6f-4dea-b706-8d7aa9ebf406 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.850509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae48152-0c6f-4dea-b706-8d7aa9ebf406 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.851944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae48152-0c6f-4dea-b706-8d7aa9ebf406 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.876206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 564/1134] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:21:53 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:55.884768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61e1ae-f12f-460f-a92c-13bfb1639e61 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.885324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61e1ae-f12f-460f-a92c-13bfb1639e61 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.885324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61e1ae-f12f-460f-a92c-13bfb1639e61 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.886696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 571/1135] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:55.891843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a494ce-253a-4730-91f7-c4129f1bff78 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.892260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a494ce-253a-4730-91f7-c4129f1bff78 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.892412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a494ce-253a-4730-91f7-c4129f1bff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.908913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-35a494ce-253a-4730-91f7-c4129f1bff78 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:55.910088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-35a494ce-253a-4730-91f7-c4129f1bff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:55.973004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 565/1136] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:55.997701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61e1ae-f12f-460f-a92c-13bfb1639e61 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:56.047024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:56.096302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61e1ae-f12f-460f-a92c-13bfb1639e61 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:56.128185 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5a2d1-130b-468e-a4f4-b5da6172ccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:56.128967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a2d1-130b-468e-a4f4-b5da6172ccd6 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:56.129249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a2d1-130b-468e-a4f4-b5da6172ccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:56.129518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a2d1-130b-468e-a4f4-b5da6172ccd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:56.130670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5a2d1-130b-468e-a4f4-b5da6172ccd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:56.132131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5a2d1-130b-468e-a4f4-b5da6172ccd6 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:56.133962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 572/1137] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:56.139495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a494ce-253a-4730-91f7-c4129f1bff78 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:56.210935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:56.235992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a494ce-253a-4730-91f7-c4129f1bff78 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:56.267501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d6e49-407d-44cb-8709-0b7b32fc0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:56.268159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6e49-407d-44cb-8709-0b7b32fc0f96 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:56.268442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6e49-407d-44cb-8709-0b7b32fc0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:56.268721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d6e49-407d-44cb-8709-0b7b32fc0f96 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:56.269415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d6e49-407d-44cb-8709-0b7b32fc0f96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:56.270842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d6e49-407d-44cb-8709-0b7b32fc0f96 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:56.291355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 566/1138] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:56 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:58.311449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840b4cb-29ea-4752-854b-a8e753c1b379 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.311999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840b4cb-29ea-4752-854b-a8e753c1b379 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.311999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840b4cb-29ea-4752-854b-a8e753c1b379 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.313429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 573/1139] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:58.318355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d20ef-30db-486d-9b4e-c8b989d9c2ae None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.318853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d20ef-30db-486d-9b4e-c8b989d9c2ae None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.318995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d20ef-30db-486d-9b4e-c8b989d9c2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.335279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d38d20ef-30db-486d-9b4e-c8b989d9c2ae None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:58.336948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d38d20ef-30db-486d-9b4e-c8b989d9c2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:58.401529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 567/1140] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:21:58.424701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840b4cb-29ea-4752-854b-a8e753c1b379 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.520450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840b4cb-29ea-4752-854b-a8e753c1b379 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:58.538112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:58.554935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5889792-9d43-4c65-a07b-51a5e1ea0c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:58.555748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889792-9d43-4c65-a07b-51a5e1ea0c2f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.556037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889792-9d43-4c65-a07b-51a5e1ea0c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.556317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889792-9d43-4c65-a07b-51a5e1ea0c2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.566043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5889792-9d43-4c65-a07b-51a5e1ea0c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d5889792-9d43-4c65-a07b-51a5e1ea0c2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:58.573670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:58.574816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:21:58.575894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 574/1141] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:58.580715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d20ef-30db-486d-9b4e-c8b989d9c2ae None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.636144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:58.676208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d20ef-30db-486d-9b4e-c8b989d9c2ae None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:58.708222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:58.708878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.709160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.709435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.710170 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:58.710479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:58.712435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:58.720134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 568/1142] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:58.725649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5889792-9d43-4c65-a07b-51a5e1ea0c2f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.822166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5889792-9d43-4c65-a07b-51a5e1ea0c2f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:58.854592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4afce-afdf-4b4b-ba44-492a4d5c1062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:58.855464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4afce-afdf-4b4b-ba44-492a4d5c1062 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.855757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4afce-afdf-4b4b-ba44-492a4d5c1062 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.856038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4afce-afdf-4b4b-ba44-492a4d5c1062 None admin] PATH_INFO: `/v3/users/55a8200b07624adeb8ce881046e3c7c8` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.868665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4afce-afdf-4b4b-ba44-492a4d5c1062 None admin] RBAC: Authorizing `identity:get_user(user_id=55a8200b07624adeb8ce881046e3c7c8)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:58.870111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4afce-afdf-4b4b-ba44-492a4d5c1062 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:58.871755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 575/1143] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/users/55a8200b07624adeb8ce881046e3c7c8 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:58.877142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.984882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618748b2-157c-48f7-a05e-3c30e5d4bd66 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.006268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.017831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92319578-7fc1-4f02-8ceb-3398992b9d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.018471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92319578-7fc1-4f02-8ceb-3398992b9d1e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.018758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92319578-7fc1-4f02-8ceb-3398992b9d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.019066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92319578-7fc1-4f02-8ceb-3398992b9d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.084136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92319578-7fc1-4f02-8ceb-3398992b9d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.085528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92319578-7fc1-4f02-8ceb-3398992b9d1e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.178957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 569/1144] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:21:59.184776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4afce-afdf-4b4b-ba44-492a4d5c1062 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.218160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.279709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4afce-afdf-4b4b-ba44-492a4d5c1062 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.312202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ddb9-1f94-4780-aa13-dcc76bfdde94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.313075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ddb9-1f94-4780-aa13-dcc76bfdde94 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.313367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ddb9-1f94-4780-aa13-dcc76bfdde94 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.313651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ddb9-1f94-4780-aa13-dcc76bfdde94 None admin] PATH_INFO: `/v3/projects/d898c8eca96c48e9b63b36da7708472e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.314854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ddb9-1f94-4780-aa13-dcc76bfdde94 None admin] RBAC: Authorizing `identity:get_project(project_id=d898c8eca96c48e9b63b36da7708472e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.316304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ddb9-1f94-4780-aa13-dcc76bfdde94 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.317982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 576/1145] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:59 2022] GET /identity/v3/projects/d898c8eca96c48e9b63b36da7708472e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:59.323917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92319578-7fc1-4f02-8ceb-3398992b9d1e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.347237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.420014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92319578-7fc1-4f02-8ceb-3398992b9d1e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.452188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dac0a-56b0-4844-ada5-35a22aa40d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.452831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dac0a-56b0-4844-ada5-35a22aa40d57 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.453114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dac0a-56b0-4844-ada5-35a22aa40d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.453390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dac0a-56b0-4844-ada5-35a22aa40d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.454202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dac0a-56b0-4844-ada5-35a22aa40d57 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d898c8eca96c48e9b63b36da7708472e, user.id=55a8200b07624adeb8ce881046e3c7c8) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:59.454512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dac0a-56b0-4844-ada5-35a22aa40d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.455974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dac0a-56b0-4844-ada5-35a22aa40d57 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.461177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 570/1146] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:59 2022] GET /identity/v3/role_assignments?user.id=55a8200b07624adeb8ce881046e3c7c8&scope.project.id=d898c8eca96c48e9b63b36da7708472e&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:01.419929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f760b-41a6-4691-8cb5-5d872205fe6f None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.420445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f760b-41a6-4691-8cb5-5d872205fe6f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.420542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f760b-41a6-4691-8cb5-5d872205fe6f None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.421878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 577/1147] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:01.426976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333cf01-e6bc-4e50-9c85-3ae5c61dcb3b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.427358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333cf01-e6bc-4e50-9c85-3ae5c61dcb3b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.427540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333cf01-e6bc-4e50-9c85-3ae5c61dcb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.444230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0333cf01-e6bc-4e50-9c85-3ae5c61dcb3b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:01.445409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0333cf01-e6bc-4e50-9c85-3ae5c61dcb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:01.509237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 571/1148] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:01.530963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f760b-41a6-4691-8cb5-5d872205fe6f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.627908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f760b-41a6-4691-8cb5-5d872205fe6f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.630137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:01.661528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b683f-dbdf-4d50-bc79-a71b587d5a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.662320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b683f-dbdf-4d50-bc79-a71b587d5a7d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.662611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b683f-dbdf-4d50-bc79-a71b587d5a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.662924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b683f-dbdf-4d50-bc79-a71b587d5a7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.672743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b683f-dbdf-4d50-bc79-a71b587d5a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-597b683f-dbdf-4d50-bc79-a71b587d5a7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:01.680891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:01.681953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:22:01.682992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 578/1149] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:01.688087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333cf01-e6bc-4e50-9c85-3ae5c61dcb3b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.705652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:01.785256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333cf01-e6bc-4e50-9c85-3ae5c61dcb3b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.818538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.819229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.819522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.819804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.820548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:01.820858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.822244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.830034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 572/1150] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:01.835641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b683f-dbdf-4d50-bc79-a71b587d5a7d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.933211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b683f-dbdf-4d50-bc79-a71b587d5a7d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.964764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041563c5-fa2c-4a28-a756-57917823924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.965630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041563c5-fa2c-4a28-a756-57917823924f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.965922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041563c5-fa2c-4a28-a756-57917823924f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.966203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041563c5-fa2c-4a28-a756-57917823924f None admin] PATH_INFO: `/v3/users/55a8200b07624adeb8ce881046e3c7c8` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.967402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041563c5-fa2c-4a28-a756-57917823924f None admin] RBAC: Authorizing `identity:get_user(user_id=55a8200b07624adeb8ce881046e3c7c8)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.968838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041563c5-fa2c-4a28-a756-57917823924f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.970427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 579/1151] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/users/55a8200b07624adeb8ce881046e3c7c8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:01.975972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.051319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:02.073249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb6479-05b2-4e27-ae16-08b47dc93df1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.105790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d36b5-eec7-41de-b3a9-e0eabcc110fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.106640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d36b5-eec7-41de-b3a9-e0eabcc110fe None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.106952 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d36b5-eec7-41de-b3a9-e0eabcc110fe None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.107229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d36b5-eec7-41de-b3a9-e0eabcc110fe None admin] PATH_INFO: `/v3/projects/d898c8eca96c48e9b63b36da7708472e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.108390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d36b5-eec7-41de-b3a9-e0eabcc110fe None admin] RBAC: Authorizing `identity:get_project(project_id=d898c8eca96c48e9b63b36da7708472e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.109812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d36b5-eec7-41de-b3a9-e0eabcc110fe None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.111503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 573/1152] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/projects/d898c8eca96c48e9b63b36da7708472e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:02.117485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041563c5-fa2c-4a28-a756-57917823924f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.147713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:02.213403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041563c5-fa2c-4a28-a756-57917823924f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.245015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68efad-765a-4bd2-a72e-cac1fac69236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.245891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68efad-765a-4bd2-a72e-cac1fac69236 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.246174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68efad-765a-4bd2-a72e-cac1fac69236 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.246445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68efad-765a-4bd2-a72e-cac1fac69236 None admin] PATH_INFO: `/v3/projects/d898c8eca96c48e9b63b36da7708472e/users/55a8200b07624adeb8ce881046e3c7c8/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.248425 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68efad-765a-4bd2-a72e-cac1fac69236 None admin] RBAC: Authorizing `identity:create_grant(project_id=d898c8eca96c48e9b63b36da7708472e, user_id=55a8200b07624adeb8ce881046e3c7c8, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.249945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68efad-765a-4bd2-a72e-cac1fac69236 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.263853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 580/1153] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:02 2022] PUT /identity/v3/projects/d898c8eca96c48e9b63b36da7708472e/users/55a8200b07624adeb8ce881046e3c7c8/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:22:04.268797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975e86-319f-4980-b2c5-9ca01c814378 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.269315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975e86-319f-4980-b2c5-9ca01c814378 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.269407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975e86-319f-4980-b2c5-9ca01c814378 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.270722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 574/1154] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:04.276787 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a6df-d49a-4daa-9952-978c1a179e02 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.277197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a6df-d49a-4daa-9952-978c1a179e02 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.277358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a6df-d49a-4daa-9952-978c1a179e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.297903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4163a6df-d49a-4daa-9952-978c1a179e02 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:04.299146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4163a6df-d49a-4daa-9952-978c1a179e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:04.363484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 581/1155] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:04.387514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f975e86-319f-4980-b2c5-9ca01c814378 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.485291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f975e86-319f-4980-b2c5-9ca01c814378 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.518279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e028a-8bba-45ba-9cb3-056fda480e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.519096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e028a-8bba-45ba-9cb3-056fda480e7b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.519388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e028a-8bba-45ba-9cb3-056fda480e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.519667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e028a-8bba-45ba-9cb3-056fda480e7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.529727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e028a-8bba-45ba-9cb3-056fda480e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-612e028a-8bba-45ba-9cb3-056fda480e7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:04.537280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:04.538355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:22:04.539298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 575/1156] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:04.544381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a6df-d49a-4daa-9952-978c1a179e02 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.567571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:04.640957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a6df-d49a-4daa-9952-978c1a179e02 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.673000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.673663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.673954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.674234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.675005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:04.675317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:04.676694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:04.684919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 582/1157] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:04.690597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e028a-8bba-45ba-9cb3-056fda480e7b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.700282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:04.786965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e028a-8bba-45ba-9cb3-056fda480e7b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.819201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8d91b-7053-4c46-a402-e198b3632a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.820057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8d91b-7053-4c46-a402-e198b3632a19 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.820341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8d91b-7053-4c46-a402-e198b3632a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.820653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8d91b-7053-4c46-a402-e198b3632a19 None admin] PATH_INFO: `/v3/users/55a8200b07624adeb8ce881046e3c7c8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.821817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8d91b-7053-4c46-a402-e198b3632a19 None admin] RBAC: Authorizing `identity:get_user(user_id=55a8200b07624adeb8ce881046e3c7c8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:04.823266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8d91b-7053-4c46-a402-e198b3632a19 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:04.824843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 576/1158] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/users/55a8200b07624adeb8ce881046e3c7c8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:04.830319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.910368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:04.925879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1f825-478f-4ea8-aaef-6ee6ad36067c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.957866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ff58-9865-41ac-bce0-89feef86369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.958506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ff58-9865-41ac-bce0-89feef86369d None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.958825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ff58-9865-41ac-bce0-89feef86369d None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.959111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ff58-9865-41ac-bce0-89feef86369d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.022810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ff58-9865-41ac-bce0-89feef86369d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.024292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ff58-9865-41ac-bce0-89feef86369d None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.105378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:05.121742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 583/1159] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:05.127679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8d91b-7053-4c46-a402-e198b3632a19 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.199574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:05.223617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8d91b-7053-4c46-a402-e198b3632a19 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.255521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f23667-d157-44c2-8c0f-4391c61d90b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.256371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f23667-d157-44c2-8c0f-4391c61d90b7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.256657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f23667-d157-44c2-8c0f-4391c61d90b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.256933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f23667-d157-44c2-8c0f-4391c61d90b7 None admin] PATH_INFO: `/v3/projects/d898c8eca96c48e9b63b36da7708472e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.258109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f23667-d157-44c2-8c0f-4391c61d90b7 None admin] RBAC: Authorizing `identity:get_project(project_id=d898c8eca96c48e9b63b36da7708472e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.259561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f23667-d157-44c2-8c0f-4391c61d90b7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.261201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 577/1160] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/projects/d898c8eca96c48e9b63b36da7708472e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:05.267143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ff58-9865-41ac-bce0-89feef86369d None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.363859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ff58-9865-41ac-bce0-89feef86369d None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.395980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7af22e-48bc-4870-8bce-8ced0063380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.396623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7af22e-48bc-4870-8bce-8ced0063380b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.396914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7af22e-48bc-4870-8bce-8ced0063380b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.397199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7af22e-48bc-4870-8bce-8ced0063380b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.398026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7af22e-48bc-4870-8bce-8ced0063380b None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d898c8eca96c48e9b63b36da7708472e, user.id=55a8200b07624adeb8ce881046e3c7c8) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:05.398345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7af22e-48bc-4870-8bce-8ced0063380b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.400561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7af22e-48bc-4870-8bce-8ced0063380b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.406202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 584/1161] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/role_assignments?user.id=55a8200b07624adeb8ce881046e3c7c8&scope.project.id=d898c8eca96c48e9b63b36da7708472e&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:07.419886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06810aaa-eb83-424d-8406-46b94ccb38f8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.420414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06810aaa-eb83-424d-8406-46b94ccb38f8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.420508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06810aaa-eb83-424d-8406-46b94ccb38f8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.421806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 578/1162] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:07.426846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24c93-9a2e-4cf3-8b8a-05d92b8d1de3 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.427255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24c93-9a2e-4cf3-8b8a-05d92b8d1de3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.427424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d24c93-9a2e-4cf3-8b8a-05d92b8d1de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.443742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a6d24c93-9a2e-4cf3-8b8a-05d92b8d1de3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:07.444932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a6d24c93-9a2e-4cf3-8b8a-05d92b8d1de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:07.488097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:07.510838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 585/1163] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:07.533362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06810aaa-eb83-424d-8406-46b94ccb38f8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.630528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06810aaa-eb83-424d-8406-46b94ccb38f8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.662760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509c36-ff56-4b82-808c-d40640ed7315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.663418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509c36-ff56-4b82-808c-d40640ed7315 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.663703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509c36-ff56-4b82-808c-d40640ed7315 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.663977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509c36-ff56-4b82-808c-d40640ed7315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.675707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:07.730361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42509c36-ff56-4b82-808c-d40640ed7315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.731830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42509c36-ff56-4b82-808c-d40640ed7315 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.826032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 579/1164] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:07.831697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d24c93-9a2e-4cf3-8b8a-05d92b8d1de3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.926652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d24c93-9a2e-4cf3-8b8a-05d92b8d1de3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.958988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227ce6c-11cb-4fdd-a602-d8c050867178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.959774 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ce6c-11cb-4fdd-a602-d8c050867178 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.960059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ce6c-11cb-4fdd-a602-d8c050867178 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.960336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ce6c-11cb-4fdd-a602-d8c050867178 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.966700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227ce6c-11cb-4fdd-a602-d8c050867178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.968156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227ce6c-11cb-4fdd-a602-d8c050867178 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-3227ce6c-11cb-4fdd-a602-d8c050867178 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:07.982312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:07.983537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:22:07.984770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 586/1165] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:07.989090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509c36-ff56-4b82-808c-d40640ed7315 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.031549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:08.087246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509c36-ff56-4b82-808c-d40640ed7315 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.119847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80ffa9-67f8-4463-a5f3-7fbc4eff8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.120505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ffa9-67f8-4463-a5f3-7fbc4eff8c42 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.120795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ffa9-67f8-4463-a5f3-7fbc4eff8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.121078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ffa9-67f8-4463-a5f3-7fbc4eff8c42 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.121797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80ffa9-67f8-4463-a5f3-7fbc4eff8c42 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:08.122109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80ffa9-67f8-4463-a5f3-7fbc4eff8c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.123490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80ffa9-67f8-4463-a5f3-7fbc4eff8c42 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.130434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 580/1166] 10.222.0.72 () {56 vars in 1115 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:10.090369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a835-82ff-4149-adcb-39dd1cef0f5b None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.090766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a835-82ff-4149-adcb-39dd1cef0f5b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.090958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a835-82ff-4149-adcb-39dd1cef0f5b None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.092338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 587/1167] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:10.097376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe193-9934-495f-847b-51b3057a6cb5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.097812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe193-9934-495f-847b-51b3057a6cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.097947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe193-9934-495f-847b-51b3057a6cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.114686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-13ffe193-9934-495f-847b-51b3057a6cb5 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:10.115912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-13ffe193-9934-495f-847b-51b3057a6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:10.180202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 581/1168] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:10.202552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502a835-82ff-4149-adcb-39dd1cef0f5b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.243184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:10.301843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502a835-82ff-4149-adcb-39dd1cef0f5b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.334405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729d4d6-3042-4c13-b3c0-5536f182384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.335036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729d4d6-3042-4c13-b3c0-5536f182384f None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.335329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729d4d6-3042-4c13-b3c0-5536f182384f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.335611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729d4d6-3042-4c13-b3c0-5536f182384f None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.336850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729d4d6-3042-4c13-b3c0-5536f182384f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.338267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729d4d6-3042-4c13-b3c0-5536f182384f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.352502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 588/1169] 10.222.0.72 () {60 vars in 1138 bytes} [Tue Jul 12 14:22:10 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:12.347107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d67fba-47a4-4d9a-a47a-0ea917ca0679 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.347598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d67fba-47a4-4d9a-a47a-0ea917ca0679 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.347690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d67fba-47a4-4d9a-a47a-0ea917ca0679 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.349022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 582/1170] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:12.354594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c031ade-0484-42fd-a742-b132243b6a6d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.355025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c031ade-0484-42fd-a742-b132243b6a6d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.355211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c031ade-0484-42fd-a742-b132243b6a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.372174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7c031ade-0484-42fd-a742-b132243b6a6d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:12.373367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7c031ade-0484-42fd-a742-b132243b6a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:12.437312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 589/1171] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:12.459794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d67fba-47a4-4d9a-a47a-0ea917ca0679 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.495499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.559165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d67fba-47a4-4d9a-a47a-0ea917ca0679 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.591093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf369a3-6e9c-4277-8517-4235846c41f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.591939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf369a3-6e9c-4277-8517-4235846c41f7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.592223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf369a3-6e9c-4277-8517-4235846c41f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.592500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf369a3-6e9c-4277-8517-4235846c41f7 None admin] PATH_INFO: `/v3/domains/ac58dfc508b84762859e2a18ab2dee2f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.603065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf369a3-6e9c-4277-8517-4235846c41f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ac58dfc508b84762859e2a18ab2dee2f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.604434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf369a3-6e9c-4277-8517-4235846c41f7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.606027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 583/1172] 10.222.0.72 () {56 vars in 1183 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/domains/ac58dfc508b84762859e2a18ab2dee2f => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:12.611691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c031ade-0484-42fd-a742-b132243b6a6d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.637536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.706617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c031ade-0484-42fd-a742-b132243b6a6d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.739578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdab8f7-37bd-47bc-8a78-ec7c4b1014f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.740236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdab8f7-37bd-47bc-8a78-ec7c4b1014f2 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.740523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdab8f7-37bd-47bc-8a78-ec7c4b1014f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.740802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdab8f7-37bd-47bc-8a78-ec7c4b1014f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.741518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdab8f7-37bd-47bc-8a78-ec7c4b1014f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.743007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdab8f7-37bd-47bc-8a78-ec7c4b1014f2 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.766466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 590/1173] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:22:12 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:14.783606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444ca2-3a5d-43c0-8640-40b4d04c9cf6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:14.784133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444ca2-3a5d-43c0-8640-40b4d04c9cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:14.784224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444ca2-3a5d-43c0-8640-40b4d04c9cf6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:14.785546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 584/1174] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:14.791066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22c4e-8e5f-4d19-987d-9d80fd63e3d5 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:14.791446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22c4e-8e5f-4d19-987d-9d80fd63e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:14.791633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22c4e-8e5f-4d19-987d-9d80fd63e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:14.808500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-96e22c4e-8e5f-4d19-987d-9d80fd63e3d5 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:14.809672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-96e22c4e-8e5f-4d19-987d-9d80fd63e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:14.872830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 591/1175] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:14.896939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39444ca2-3a5d-43c0-8640-40b4d04c9cf6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:14.988988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:14.995828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39444ca2-3a5d-43c0-8640-40b4d04c9cf6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:15.028613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e33d-30cb-4069-b754-ed04fc19397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:15.029472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e33d-30cb-4069-b754-ed04fc19397f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.029760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e33d-30cb-4069-b754-ed04fc19397f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.030040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e33d-30cb-4069-b754-ed04fc19397f None admin] PATH_INFO: `/v3/domains/ac58dfc508b84762859e2a18ab2dee2f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.031235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93e33d-30cb-4069-b754-ed04fc19397f None admin] RBAC: Authorizing `identity:get_domain(domain_id=ac58dfc508b84762859e2a18ab2dee2f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:15.032661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93e33d-30cb-4069-b754-ed04fc19397f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:15.034299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 585/1176] 10.222.0.72 () {56 vars in 1183 bytes} [Tue Jul 12 14:22:14 2022] GET /identity/v3/domains/ac58dfc508b84762859e2a18ab2dee2f => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:15.040366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e22c4e-8e5f-4d19-987d-9d80fd63e3d5 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:15.051771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:15.138527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e22c4e-8e5f-4d19-987d-9d80fd63e3d5 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:15.171667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e6e74-696c-4db7-b129-8845625d72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:15.172337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e6e74-696c-4db7-b129-8845625d72be None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.172625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e6e74-696c-4db7-b129-8845625d72be None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.172903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e6e74-696c-4db7-b129-8845625d72be None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.173617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e6e74-696c-4db7-b129-8845625d72be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:15.175077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e6e74-696c-4db7-b129-8845625d72be None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:15.193236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 592/1177] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:22:15 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:17.222199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191558-fed3-4f3a-826d-9decf22de9d7 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.222793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191558-fed3-4f3a-826d-9decf22de9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.222793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191558-fed3-4f3a-826d-9decf22de9d7 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.224169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 586/1178] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:17.229923 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fdba1-b53d-4f6e-b32e-fc7f260e03fe None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.230351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fdba1-b53d-4f6e-b32e-fc7f260e03fe None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.230488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fdba1-b53d-4f6e-b32e-fc7f260e03fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.247007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-282fdba1-b53d-4f6e-b32e-fc7f260e03fe None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:17.248199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-282fdba1-b53d-4f6e-b32e-fc7f260e03fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:17.305684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.313726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 593/1179] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:17.337594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191558-fed3-4f3a-826d-9decf22de9d7 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.436269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191558-fed3-4f3a-826d-9decf22de9d7 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.469497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bdcfb-a135-4654-960f-776512a93872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.470280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bdcfb-a135-4654-960f-776512a93872 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.470571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bdcfb-a135-4654-960f-776512a93872 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.470882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bdcfb-a135-4654-960f-776512a93872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.480734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bdcfb-a135-4654-960f-776512a93872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-561bdcfb-a135-4654-960f-776512a93872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:17.488353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:17.489492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:22:17.490588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 587/1180] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:17.495532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fdba1-b53d-4f6e-b32e-fc7f260e03fe None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.589741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fdba1-b53d-4f6e-b32e-fc7f260e03fe None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.621902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.622569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.622882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.623161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.623911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:17.624222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:17.625597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:17.633938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 594/1181] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:17.639578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bdcfb-a135-4654-960f-776512a93872 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.665403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.738159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bdcfb-a135-4654-960f-776512a93872 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.770949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47ba86-31dd-484e-a475-c651b20f02bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.771807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ba86-31dd-484e-a475-c651b20f02bc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.772094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ba86-31dd-484e-a475-c651b20f02bc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.772375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47ba86-31dd-484e-a475-c651b20f02bc None admin] PATH_INFO: `/v3/users/0da55abc15604eba8a39e3315468d1ae` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.785795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47ba86-31dd-484e-a475-c651b20f02bc None admin] RBAC: Authorizing `identity:get_user(user_id=0da55abc15604eba8a39e3315468d1ae)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:17.787284 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47ba86-31dd-484e-a475-c651b20f02bc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:17.788939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 588/1182] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/users/0da55abc15604eba8a39e3315468d1ae => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:17.794388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.854348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.894651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608dd5-0e29-450d-b1bb-551d4472f54f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.926107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa68da-7083-4d28-99c3-f92a32061714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.926748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa68da-7083-4d28-99c3-f92a32061714 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.927062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa68da-7083-4d28-99c3-f92a32061714 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.927339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa68da-7083-4d28-99c3-f92a32061714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.990441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa68da-7083-4d28-99c3-f92a32061714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:17.992432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa68da-7083-4d28-99c3-f92a32061714 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.045955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:18.088056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 595/1183] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:18.093784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47ba86-31dd-484e-a475-c651b20f02bc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.171900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:18.189031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47ba86-31dd-484e-a475-c651b20f02bc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.221583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a8ca3-0bb0-450c-a683-e078ff64b9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.222431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8ca3-0bb0-450c-a683-e078ff64b9ae None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.222987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8ca3-0bb0-450c-a683-e078ff64b9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.223091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8ca3-0bb0-450c-a683-e078ff64b9ae None admin] PATH_INFO: `/v3/projects/313846f88be0493c8974808f1c11a7e7` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.224152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a8ca3-0bb0-450c-a683-e078ff64b9ae None admin] RBAC: Authorizing `identity:get_project(project_id=313846f88be0493c8974808f1c11a7e7)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.225565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a8ca3-0bb0-450c-a683-e078ff64b9ae None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.227326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 589/1184] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:18 2022] GET /identity/v3/projects/313846f88be0493c8974808f1c11a7e7 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:18.233180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa68da-7083-4d28-99c3-f92a32061714 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.327315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa68da-7083-4d28-99c3-f92a32061714 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.360638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbbc1-4e4d-4eca-a3a4-f4590bbf813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.361283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbbc1-4e4d-4eca-a3a4-f4590bbf813e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.361576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbbc1-4e4d-4eca-a3a4-f4590bbf813e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.361854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbbc1-4e4d-4eca-a3a4-f4590bbf813e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.362670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fbbc1-4e4d-4eca-a3a4-f4590bbf813e None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=313846f88be0493c8974808f1c11a7e7, user.id=0da55abc15604eba8a39e3315468d1ae) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:18.363016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fbbc1-4e4d-4eca-a3a4-f4590bbf813e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.364465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fbbc1-4e4d-4eca-a3a4-f4590bbf813e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.369723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 596/1185] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:18 2022] GET /identity/v3/role_assignments?user.id=0da55abc15604eba8a39e3315468d1ae&scope.project.id=313846f88be0493c8974808f1c11a7e7&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:20.346420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72b3f-e9ef-4bfa-908a-12beb1ae743b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.346996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72b3f-e9ef-4bfa-908a-12beb1ae743b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.346996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72b3f-e9ef-4bfa-908a-12beb1ae743b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.348298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 590/1186] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:20.354155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f25f5-2cba-4599-bee1-b0c3e61c60e4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.354572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f25f5-2cba-4599-bee1-b0c3e61c60e4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.354724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f25f5-2cba-4599-bee1-b0c3e61c60e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.371030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-217f25f5-2cba-4599-bee1-b0c3e61c60e4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:20.372203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-217f25f5-2cba-4599-bee1-b0c3e61c60e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:20.387958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:20.436980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 597/1187] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:20.459547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72b3f-e9ef-4bfa-908a-12beb1ae743b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.556375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72b3f-e9ef-4bfa-908a-12beb1ae743b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:20.588951 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc336d6-5d49-4de8-92c5-b90e96b070bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:20.589723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc336d6-5d49-4de8-92c5-b90e96b070bf None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.590006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc336d6-5d49-4de8-92c5-b90e96b070bf None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.590280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc336d6-5d49-4de8-92c5-b90e96b070bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.599966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc336d6-5d49-4de8-92c5-b90e96b070bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2bc336d6-5d49-4de8-92c5-b90e96b070bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:20.607474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:20.608545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:22:20.609549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 591/1188] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:20.614414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f25f5-2cba-4599-bee1-b0c3e61c60e4 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.708803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f25f5-2cba-4599-bee1-b0c3e61c60e4 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:20.740967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:20.741623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.741913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.742196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.742970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:20.743282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:20.744656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:20.752402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 598/1189] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:20.758246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc336d6-5d49-4de8-92c5-b90e96b070bf None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.770583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:20.855090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc336d6-5d49-4de8-92c5-b90e96b070bf None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:20.887420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00c9c8-38df-46b0-b661-6eda2180a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:20.888273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c9c8-38df-46b0-b661-6eda2180a31f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.888556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c9c8-38df-46b0-b661-6eda2180a31f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.888833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00c9c8-38df-46b0-b661-6eda2180a31f None admin] PATH_INFO: `/v3/users/0da55abc15604eba8a39e3315468d1ae` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.889989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00c9c8-38df-46b0-b661-6eda2180a31f None admin] RBAC: Authorizing `identity:get_user(user_id=0da55abc15604eba8a39e3315468d1ae)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:20.891431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00c9c8-38df-46b0-b661-6eda2180a31f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:20.893009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 592/1190] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/users/0da55abc15604eba8a39e3315468d1ae => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:20.898844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.914529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:20.994956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b38e30-dd3d-4be1-b6f6-aa3f95115496 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.027169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef51a35-258b-494d-a504-3a6f764faa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.028014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef51a35-258b-494d-a504-3a6f764faa56 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.028299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef51a35-258b-494d-a504-3a6f764faa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.028576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef51a35-258b-494d-a504-3a6f764faa56 None admin] PATH_INFO: `/v3/projects/313846f88be0493c8974808f1c11a7e7` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.029744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef51a35-258b-494d-a504-3a6f764faa56 None admin] RBAC: Authorizing `identity:get_project(project_id=313846f88be0493c8974808f1c11a7e7)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.031211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef51a35-258b-494d-a504-3a6f764faa56 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.032870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 599/1191] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/projects/313846f88be0493c8974808f1c11a7e7 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:21.039689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00c9c8-38df-46b0-b661-6eda2180a31f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.123397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:21.145868 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00c9c8-38df-46b0-b661-6eda2180a31f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.177525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e129e90-c9ca-4309-9be7-62723cae49c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.178409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129e90-c9ca-4309-9be7-62723cae49c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.178696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129e90-c9ca-4309-9be7-62723cae49c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.179519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129e90-c9ca-4309-9be7-62723cae49c2 None admin] PATH_INFO: `/v3/projects/313846f88be0493c8974808f1c11a7e7/users/0da55abc15604eba8a39e3315468d1ae/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.181437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129e90-c9ca-4309-9be7-62723cae49c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=313846f88be0493c8974808f1c11a7e7, user_id=0da55abc15604eba8a39e3315468d1ae, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.182878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129e90-c9ca-4309-9be7-62723cae49c2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.194574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 593/1192] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:21 2022] PUT /identity/v3/projects/313846f88be0493c8974808f1c11a7e7/users/0da55abc15604eba8a39e3315468d1ae/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:22:23.163820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051dde8-5463-43fa-88eb-6ddcfe221756 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.164356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051dde8-5463-43fa-88eb-6ddcfe221756 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.164356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051dde8-5463-43fa-88eb-6ddcfe221756 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.165729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 600/1193] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:23.171263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec5cd-416b-4860-910f-acea93e6ec31 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.171692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec5cd-416b-4860-910f-acea93e6ec31 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.171833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec5cd-416b-4860-910f-acea93e6ec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.188220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-282ec5cd-416b-4860-910f-acea93e6ec31 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:23.189410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-282ec5cd-416b-4860-910f-acea93e6ec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:23.254190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 594/1194] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:23.277458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051dde8-5463-43fa-88eb-6ddcfe221756 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.357030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:23.375566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051dde8-5463-43fa-88eb-6ddcfe221756 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.408107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc18c77-f2e5-44cc-a1fe-3c9f7a0b9430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.408880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18c77-f2e5-44cc-a1fe-3c9f7a0b9430 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.409165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18c77-f2e5-44cc-a1fe-3c9f7a0b9430 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.409439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18c77-f2e5-44cc-a1fe-3c9f7a0b9430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.419699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc18c77-f2e5-44cc-a1fe-3c9f7a0b9430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-8cc18c77-f2e5-44cc-a1fe-3c9f7a0b9430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:23.427251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:23.428410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:22:23.429465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 601/1195] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:23.434332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ec5cd-416b-4860-910f-acea93e6ec31 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.497732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:23.532684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ec5cd-416b-4860-910f-acea93e6ec31 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.564815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.565479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.565768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.566052 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.566819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:23.567135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.568501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:23.576825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 595/1196] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:23.582384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc18c77-f2e5-44cc-a1fe-3c9f7a0b9430 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.678272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc18c77-f2e5-44cc-a1fe-3c9f7a0b9430 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.710025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b13f-e072-4fd4-b586-ba3534b9de93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.711458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b13f-e072-4fd4-b586-ba3534b9de93 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.711745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b13f-e072-4fd4-b586-ba3534b9de93 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.712023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b13f-e072-4fd4-b586-ba3534b9de93 None admin] PATH_INFO: `/v3/users/0da55abc15604eba8a39e3315468d1ae` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.713190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167b13f-e072-4fd4-b586-ba3534b9de93 None admin] RBAC: Authorizing `identity:get_user(user_id=0da55abc15604eba8a39e3315468d1ae)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.714621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167b13f-e072-4fd4-b586-ba3534b9de93 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:23.716246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 602/1197] 10.222.0.72 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:23 2022] GET /identity/v3/users/0da55abc15604eba8a39e3315468d1ae => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:23.721590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.817374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7a85-5fca-4053-a31c-bf60d400daa9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.845663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:23.851666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a936-b590-42c6-9691-ff0b9259852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.852311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a936-b590-42c6-9691-ff0b9259852d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.852603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a936-b590-42c6-9691-ff0b9259852d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.852903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1a936-b590-42c6-9691-ff0b9259852d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.917445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1a936-b590-42c6-9691-ff0b9259852d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.918911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1a936-b590-42c6-9691-ff0b9259852d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:24.013035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 596/1198] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 14:22:24.018605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b13f-e072-4fd4-b586-ba3534b9de93 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:24.031734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:24.115609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b13f-e072-4fd4-b586-ba3534b9de93 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:24.148533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225fe81-a4d7-4c93-8a8a-f52a27592963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:24.149645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225fe81-a4d7-4c93-8a8a-f52a27592963 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:24.149928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225fe81-a4d7-4c93-8a8a-f52a27592963 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:24.150202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225fe81-a4d7-4c93-8a8a-f52a27592963 None admin] PATH_INFO: `/v3/projects/313846f88be0493c8974808f1c11a7e7` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:24.151377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225fe81-a4d7-4c93-8a8a-f52a27592963 None admin] RBAC: Authorizing `identity:get_project(project_id=313846f88be0493c8974808f1c11a7e7)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:24.152805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225fe81-a4d7-4c93-8a8a-f52a27592963 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:24.154478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 603/1199] 10.222.0.72 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:24 2022] GET /identity/v3/projects/313846f88be0493c8974808f1c11a7e7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:24.160470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a936-b590-42c6-9691-ff0b9259852d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:24.189348 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:24.255309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1a936-b590-42c6-9691-ff0b9259852d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:24.288416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0138e7-78f7-4ae1-ab35-a436cc5c164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:24.289007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0138e7-78f7-4ae1-ab35-a436cc5c164c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:24.289291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0138e7-78f7-4ae1-ab35-a436cc5c164c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:24.289565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0138e7-78f7-4ae1-ab35-a436cc5c164c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:24.290382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0138e7-78f7-4ae1-ab35-a436cc5c164c None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=313846f88be0493c8974808f1c11a7e7, user.id=0da55abc15604eba8a39e3315468d1ae) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:24.290693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0138e7-78f7-4ae1-ab35-a436cc5c164c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:24.292123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0138e7-78f7-4ae1-ab35-a436cc5c164c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:24.297717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 597/1200] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:24 2022] GET /identity/v3/role_assignments?user.id=0da55abc15604eba8a39e3315468d1ae&scope.project.id=313846f88be0493c8974808f1c11a7e7&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:34.144341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=61 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:34.295227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=53 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:19.250676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44b4d-c8da-4d00-a926-7fa6d92552c3 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:19.250676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44b4d-c8da-4d00-a926-7fa6d92552c3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:19.250676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44b4d-c8da-4d00-a926-7fa6d92552c3 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:19.250676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 604/1201] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:19.256051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66ae2-a2a5-4a5b-950d-d7fb1490f132 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:19.256528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66ae2-a2a5-4a5b-950d-d7fb1490f132 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:19.256727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66ae2-a2a5-4a5b-950d-d7fb1490f132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:19.276163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-77a66ae2-a2a5-4a5b-950d-d7fb1490f132 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:19.277365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-77a66ae2-a2a5-4a5b-950d-d7fb1490f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:19.359989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 598/1202] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:19.388385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c44b4d-c8da-4d00-a926-7fa6d92552c3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:19.536167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c44b4d-c8da-4d00-a926-7fa6d92552c3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:19.578673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:19.579514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:19.579804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:19.580080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:19.593555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:19.595246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:19.618235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:19.619338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:19.620300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:19.620300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:19.620300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:19.620300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:19.626046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 605/1203] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:19.627793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a66ae2-a2a5-4a5b-950d-d7fb1490f132 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:19.766503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a66ae2-a2a5-4a5b-950d-d7fb1490f132 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:19.805974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:19.812938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca791c0-9bca-4f26-9b5f-d3c276ba3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:19.813686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca791c0-9bca-4f26-9b5f-d3c276ba3fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:19.813982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca791c0-9bca-4f26-9b5f-d3c276ba3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:19.814268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca791c0-9bca-4f26-9b5f-d3c276ba3fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:19.815371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca791c0-9bca-4f26-9b5f-d3c276ba3fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:19.815869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca791c0-9bca-4f26-9b5f-d3c276ba3fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:19.817452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca791c0-9bca-4f26-9b5f-d3c276ba3fb8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:19.833675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 599/1204] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:19.840664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:19.909532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:19.973869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeefb53-7a8e-4044-bde5-626762ae7a03 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:20.015337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03f6c-e5f0-4418-aeb8-c113863ea8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:20.016013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03f6c-e5f0-4418-aeb8-c113863ea8b8 None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:20.016300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03f6c-e5f0-4418-aeb8-c113863ea8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:20.016576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03f6c-e5f0-4418-aeb8-c113863ea8b8 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:20.017279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03f6c-e5f0-4418-aeb8-c113863ea8b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:20.018721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03f6c-e5f0-4418-aeb8-c113863ea8b8 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:20.054826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 606/1205] 10.222.0.72 () {60 vars in 1132 bytes} [Tue Jul 12 14:23:19 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:23:22.313745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69726dcc-b483-4bbb-943f-189c848ad915 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:22.314337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69726dcc-b483-4bbb-943f-189c848ad915 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:22.314337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69726dcc-b483-4bbb-943f-189c848ad915 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:22.315649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 600/1206] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:22.322687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3799ec-1357-4c53-bb6d-8ccdff49de78 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:22.322687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3799ec-1357-4c53-bb6d-8ccdff49de78 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:22.322687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3799ec-1357-4c53-bb6d-8ccdff49de78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:22.342601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ef3799ec-1357-4c53-bb6d-8ccdff49de78 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:22.343850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ef3799ec-1357-4c53-bb6d-8ccdff49de78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:22.426637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 607/1207] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:22.454147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69726dcc-b483-4bbb-943f-189c848ad915 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:22.579670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69726dcc-b483-4bbb-943f-189c848ad915 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:22.619311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0fb5-bebd-4364-96b8-72c7c9b93d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:22.621655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0fb5-bebd-4364-96b8-72c7c9b93d7c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:22.621655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0fb5-bebd-4364-96b8-72c7c9b93d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:22.621655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0fb5-bebd-4364-96b8-72c7c9b93d7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:22.632871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e0fb5-bebd-4364-96b8-72c7c9b93d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-562e0fb5-bebd-4364-96b8-72c7c9b93d7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:22.641654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:22.642641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:23:22.643541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:22.644186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 601/1208] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:22.650032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3799ec-1357-4c53-bb6d-8ccdff49de78 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:22.694094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:22.762697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3799ec-1357-4c53-bb6d-8ccdff49de78 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:22.804729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:22.805445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:22.805741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:22.806030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:22.806821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:22.807150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:22.808542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:22.817043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 608/1209] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:23:22.823187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0fb5-bebd-4364-96b8-72c7c9b93d7c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:22.882591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:22.936994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0fb5-bebd-4364-96b8-72c7c9b93d7c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:22.979573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:22.980846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:22.981211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:22.981514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:22.994664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:22.996373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:23.016421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:23.017702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:23.019310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:23.019310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:23.019310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:23.019310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:23.019310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 602/1210] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:23.024099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:23.145284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:23.148562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6e1b1-4a41-4fca-aa60-4c1b5cb009f3 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:23.191591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:23.192378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:23.192665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:23.192947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:23.194386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:23.194696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:23.196136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:23.211606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 609/1211] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:23.217340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:23.347167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fe74-f75f-46f4-84fd-ad2cc5eb7383 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:23.348893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:23.390462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:23.391437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:23.392461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:23.392461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:23.401466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:23.403021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:23:23.419623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:23.420608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:23.421586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 603/1212] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:23.427381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:23.557611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f5a8-c4ac-490e-a390-c41559961aad None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:23.594278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:23.594988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:23.595275 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:23.595560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:23.596472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:23.596781 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:23.598293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:23.621547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 610/1213] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jul 12 14:23:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:23.623276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:23.738574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfb5d4-04e1-42f5-837a-c56bb5be0ef5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:23.776148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c9b32-a920-48a2-9d2e-41469b320f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:23.776884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c9b32-a920-48a2-9d2e-41469b320f30 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:23.777190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c9b32-a920-48a2-9d2e-41469b320f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:23.777497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c9b32-a920-48a2-9d2e-41469b320f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:23.812798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:23.871142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c9b32-a920-48a2-9d2e-41469b320f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:23.872734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c9b32-a920-48a2-9d2e-41469b320f30 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:23.994306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 604/1214] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:24.000117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:24.019442 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:24.111058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea5ff-3844-4bcb-ad87-de7b13c89723 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:24.152028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:24.152848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:24.153133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:24.153410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:24.165611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:24.167129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:24.189840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:24.190869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:24.191741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:24.191741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:24.191741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:24.191741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:24.191741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 611/1215] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:24.200515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c9b32-a920-48a2-9d2e-41469b320f30 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:24.273049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:24.321584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c9b32-a920-48a2-9d2e-41469b320f30 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:24.357936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:24.358652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:24.358918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:24.359198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:24.359922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:24.360274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:24.361591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:24.373490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 605/1216] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:24.379796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:24.462032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:24.495238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3ce0b-bd72-4d76-a8c3-28c48ee6279c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:24.534183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:24.534951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:24.535239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:24.535515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:24.542452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:24.543940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:23:24.557604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:24.563797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:24.564726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 612/1217] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:23:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:23:24.565248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:24.674083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc484-9794-49ec-917d-ccaa82a598c3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:24.699807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:24.713624 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5d07d-3bc8-46c7-8d9a-3506da8cf97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:24.714391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d07d-3bc8-46c7-8d9a-3506da8cf97e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:24.714668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d07d-3bc8-46c7-8d9a-3506da8cf97e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:24.714980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d07d-3bc8-46c7-8d9a-3506da8cf97e None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:24.715813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5d07d-3bc8-46c7-8d9a-3506da8cf97e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:24.716129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5d07d-3bc8-46c7-8d9a-3506da8cf97e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:24.717600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5d07d-3bc8-46c7-8d9a-3506da8cf97e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:24.735961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 606/1218] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:24.737216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:24.854401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1fc02-7fdb-4453-acd3-49b7070d961c None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:24.886958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:24.894573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c20bb-5f72-4730-a3a1-838320f09b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:24.895277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c20bb-5f72-4730-a3a1-838320f09b5c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:24.895588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c20bb-5f72-4730-a3a1-838320f09b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:24.895870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c20bb-5f72-4730-a3a1-838320f09b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:24.896845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c20bb-5f72-4730-a3a1-838320f09b5c None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=f63e307bc2f445dbaa67aac26dadbb64) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:24.897291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c20bb-5f72-4730-a3a1-838320f09b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:24.898511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c20bb-5f72-4730-a3a1-838320f09b5c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:24.905176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 613/1219] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:23:24 2022] GET /identity/v3/role_assignments?user.id=f63e307bc2f445dbaa67aac26dadbb64&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:27.137660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869c7ca-4e41-4d0f-b743-51bca8feec3d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:27.138223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869c7ca-4e41-4d0f-b743-51bca8feec3d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:27.138380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869c7ca-4e41-4d0f-b743-51bca8feec3d None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:27.140043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 607/1220] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:27.145815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d346f1-029e-48e3-873c-24b58ff30c5c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:27.146262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d346f1-029e-48e3-873c-24b58ff30c5c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:27.146480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d346f1-029e-48e3-873c-24b58ff30c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:27.163398 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-81d346f1-029e-48e3-873c-24b58ff30c5c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:27.164611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-81d346f1-029e-48e3-873c-24b58ff30c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:27.236976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 614/1221] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:27.259976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869c7ca-4e41-4d0f-b743-51bca8feec3d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:27.363803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869c7ca-4e41-4d0f-b743-51bca8feec3d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:27.400704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e181a-ea32-431b-aa7c-4ea8bc62dc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:27.401512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e181a-ea32-431b-aa7c-4ea8bc62dc58 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:27.401802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e181a-ea32-431b-aa7c-4ea8bc62dc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:27.402081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e181a-ea32-431b-aa7c-4ea8bc62dc58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:27.412686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e181a-ea32-431b-aa7c-4ea8bc62dc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-782e181a-ea32-431b-aa7c-4ea8bc62dc58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:27.421043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:27.422165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:27.423377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 608/1222] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:23:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:27.429268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d346f1-029e-48e3-873c-24b58ff30c5c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:27.536245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d346f1-029e-48e3-873c-24b58ff30c5c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:27.562717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:27.576792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:27.577633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:27.578107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:27.578588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:27.579606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] RBAC: Adding query filter params (name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:27.580071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:27.581643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:27.591626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 615/1223] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:23:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:27.598011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e181a-ea32-431b-aa7c-4ea8bc62dc58 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:27.644287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:27.701313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e181a-ea32-431b-aa7c-4ea8bc62dc58 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:27.736137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:27.736936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:27.737222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:27.737498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:27.747906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:27.749384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:27.766009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:27.766995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:27.767956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:27.767956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:27.767956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:27.767956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:27.767956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 609/1224] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:27.773681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:27.884242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca964c5-97da-4d2d-9335-d2e83da30368 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:27.921197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:27.921996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:27.922320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:27.922638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:27.923464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:27.923776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:27.925282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:27.939168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 616/1225] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:27.946359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:28.045506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:28.052680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93cd1-ef21-496d-9f85-76995d0ea4f9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:28.088937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:28.089746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:28.090076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:28.090330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:28.098108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:28.099586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:23:28.114078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:28.115310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:28.116456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 610/1226] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:28.121426 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:28.173092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:28.232004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc7cfe-473d-4580-94d2-fb8e0896b1cb None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:28.267747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:28.268426 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:28.268712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:28.268993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:28.269831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:28.270145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:28.272434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:28.292669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 617/1227] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jul 12 14:23:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:28.298058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:28.404014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea74a01-fc32-40ab-8cf7-fa64728af614 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:28.441083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:28.441834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:28.442140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:28.442407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:28.454489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:28.456347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:28.474124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:28.475256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:28.476261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:28.476261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:28.476261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:28.476261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:28.476261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 611/1228] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:28.481202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:28.584079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2b6b2-be4c-4de3-8052-550febae0ce4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:28.586494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:28.619401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:28.620072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:28.620360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:28.620640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:28.621362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:28.621672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:28.623076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:28.636209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 618/1229] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:23:28.641834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:28.651660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:28.747525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504826-f15e-4050-bdec-21fa1315734c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:28.783675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:28.784485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:28.784773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:28.785051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:28.792659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:28.794106 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:23:28.808801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:28.809789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:28.810687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 612/1230] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:28.815996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:28.926874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa949c-68c4-4d2c-a1c4-a699bf978150 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:28.964573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c1d8e-9bce-4063-9c0d-9ecf4e8b5f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:28.965245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1d8e-9bce-4063-9c0d-9ecf4e8b5f54 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:28.965539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1d8e-9bce-4063-9c0d-9ecf4e8b5f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:28.965812 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1d8e-9bce-4063-9c0d-9ecf4e8b5f54 None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:28.966598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c1d8e-9bce-4063-9c0d-9ecf4e8b5f54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:28.966952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c1d8e-9bce-4063-9c0d-9ecf4e8b5f54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:28.968390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c1d8e-9bce-4063-9c0d-9ecf4e8b5f54 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:28.981327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 619/1231] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:23:28.987271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:29.059304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:29.095539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e557e07-0f63-402f-ba48-7b8216fb7063 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:29.131618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3272-0cfc-44e4-83e7-f627d5295dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:29.132515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3272-0cfc-44e4-83e7-f627d5295dc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:29.132802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3272-0cfc-44e4-83e7-f627d5295dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:29.133082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3272-0cfc-44e4-83e7-f627d5295dc1 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/f63e307bc2f445dbaa67aac26dadbb64/roles/b7366b7493b54614bff185596a63f32f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:29.148281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a3272-0cfc-44e4-83e7-f627d5295dc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=f63e307bc2f445dbaa67aac26dadbb64, role_id=b7366b7493b54614bff185596a63f32f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:29.149693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a3272-0cfc-44e4-83e7-f627d5295dc1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:29.161414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 613/1232] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:23:28 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/f63e307bc2f445dbaa67aac26dadbb64/roles/b7366b7493b54614bff185596a63f32f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:23:31.157094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb98c-62d9-4367-85a1-d1259c67be70 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:31.157831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb98c-62d9-4367-85a1-d1259c67be70 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:31.157831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb98c-62d9-4367-85a1-d1259c67be70 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:31.159074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 620/1233] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:31.164403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769dd56-747f-42bc-ac10-d29d74a96233 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:31.164835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769dd56-747f-42bc-ac10-d29d74a96233 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:31.164991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769dd56-747f-42bc-ac10-d29d74a96233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:31.184276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9769dd56-747f-42bc-ac10-d29d74a96233 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:31.185501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9769dd56-747f-42bc-ac10-d29d74a96233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:31.261264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 614/1234] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:23:31.284731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cb98c-62d9-4367-85a1-d1259c67be70 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:31.309331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:31.389904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cb98c-62d9-4367-85a1-d1259c67be70 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:31.423795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6630-4f57-41f5-a1ed-83ab8aefe7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:31.424605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6630-4f57-41f5-a1ed-83ab8aefe7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:31.424892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6630-4f57-41f5-a1ed-83ab8aefe7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:31.425172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6630-4f57-41f5-a1ed-83ab8aefe7a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:31.436634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f6630-4f57-41f5-a1ed-83ab8aefe7a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f26f6630-4f57-41f5-a1ed-83ab8aefe7a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:31.445039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:31.446166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:23:31.447242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:31.451268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 621/1235] 10.222.0.72 () {56 vars in 1102 bytes} [Tue Jul 12 14:23:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:31.452367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769dd56-747f-42bc-ac10-d29d74a96233 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:31.504254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:31.565704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769dd56-747f-42bc-ac10-d29d74a96233 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:31.600366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:31.601058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:31.601346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:31.601624 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:31.602366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:31.602731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:31.604120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:31.612247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 615/1236] 10.222.0.72 () {56 vars in 1103 bytes} [Tue Jul 12 14:23:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:31.617881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6630-4f57-41f5-a1ed-83ab8aefe7a5 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:31.709049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:31.726688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6630-4f57-41f5-a1ed-83ab8aefe7a5 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:31.765507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:31.766342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:31.766594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:31.766901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:31.778799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:31.780273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:31.797763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:31.798876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:31.799982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:31.799982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:31.799982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:31.799982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:31.799982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 622/1237] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:31.804973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:31.920156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc11486-9952-46dd-a5a8-e5944370b40e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:31.931406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:31.958164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:31.958862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:31.959242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:31.959477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:31.960203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:31.960589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:31.962200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:31.975469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 616/1238] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:31.981851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.098814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcf69b-ef95-4689-9544-8693a8048d0a None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.137331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.138248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.138546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.138924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.142246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:32.150751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.152450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:23:32.167676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:32.169129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:32.170118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 623/1239] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:32.175098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.282224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc419f1-d415-4ff4-b33b-48cea0caad83 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.320671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.321349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.321637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.321914 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.322746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:32.323087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.324562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.348445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 617/1240] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:32.351461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.463723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626281d-6036-4b93-b82d-c43b084239e1 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.503201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3491ba-cc66-478f-97aa-c2d2a4be30d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.504046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3491ba-cc66-478f-97aa-c2d2a4be30d4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.504411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3491ba-cc66-478f-97aa-c2d2a4be30d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.504731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3491ba-cc66-478f-97aa-c2d2a4be30d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.574019 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:32.580825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3491ba-cc66-478f-97aa-c2d2a4be30d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.582359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3491ba-cc66-478f-97aa-c2d2a4be30d4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.697639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 624/1241] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:32.703566 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.732300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:32.813641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25c8fa-c818-4a5f-a4ac-87dbb22893e8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.858094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.859222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.859734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.860174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.875687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.877897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:32.904324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:32.906200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:32.907832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:32.907832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:32.907832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:32.907832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:32.907832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 618/1242] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:32.913009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3491ba-cc66-478f-97aa-c2d2a4be30d4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:33.027314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:33.033397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3491ba-cc66-478f-97aa-c2d2a4be30d4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:33.070850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:33.071530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:33.071821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:33.072098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:33.072826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:33.073135 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:33.074522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:33.086938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 625/1243] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:23:33.092810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:33.180444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:33.204280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c684-e688-4d24-b60c-f363baca6c6c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:33.240973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:33.241824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:33.242116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:33.242399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:33.249795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:33.251391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:23:33.266382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:33.267528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:33.273517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 619/1244] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:23:33.274121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:33.385619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362aecc-1d1c-4dab-811d-52d1657d6d28 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:33.423857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5851be5-c4e0-4ccc-95e2-3d065eb03a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:33.427189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851be5-c4e0-4ccc-95e2-3d065eb03a5e None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:33.427481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851be5-c4e0-4ccc-95e2-3d065eb03a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:33.427772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851be5-c4e0-4ccc-95e2-3d065eb03a5e None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:33.428572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851be5-c4e0-4ccc-95e2-3d065eb03a5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:33.428889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851be5-c4e0-4ccc-95e2-3d065eb03a5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:33.431070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851be5-c4e0-4ccc-95e2-3d065eb03a5e None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:33.444998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 626/1245] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:33.451109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:33.560193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69656267-c397-4538-9b1c-001cbe6424b6 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:33.598570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30eea85-2bc5-459b-8e13-4705475aa574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:33.599363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30eea85-2bc5-459b-8e13-4705475aa574 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:33.600315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30eea85-2bc5-459b-8e13-4705475aa574 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:33.600678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30eea85-2bc5-459b-8e13-4705475aa574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:33.601637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30eea85-2bc5-459b-8e13-4705475aa574 None admin] RBAC: Adding query filter params (role.id=b7366b7493b54614bff185596a63f32f, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=f63e307bc2f445dbaa67aac26dadbb64) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:33.602032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30eea85-2bc5-459b-8e13-4705475aa574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:33.604361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30eea85-2bc5-459b-8e13-4705475aa574 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:33.612205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 620/1246] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:23:33 2022] GET /identity/v3/role_assignments?user.id=f63e307bc2f445dbaa67aac26dadbb64&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=b7366b7493b54614bff185596a63f32f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:35.868980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a2930-5308-475b-89f4-d9eca9c2f174 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:35.868980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a2930-5308-475b-89f4-d9eca9c2f174 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:35.868980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a2930-5308-475b-89f4-d9eca9c2f174 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:35.870062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 627/1247] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:35.875890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d877970-b5c6-46ee-aea0-0c30bc1598ee None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:35.876662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d877970-b5c6-46ee-aea0-0c30bc1598ee None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:35.876662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d877970-b5c6-46ee-aea0-0c30bc1598ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:35.881637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:35.897762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5d877970-b5c6-46ee-aea0-0c30bc1598ee None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:35.899345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5d877970-b5c6-46ee-aea0-0c30bc1598ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:35.982429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 621/1248] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:36.008556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a2930-5308-475b-89f4-d9eca9c2f174 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:36.030312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:36.133128 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a2930-5308-475b-89f4-d9eca9c2f174 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:36.173411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1da98-8e55-46a1-9c39-b3e6cdcfc897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:36.174363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1da98-8e55-46a1-9c39-b3e6cdcfc897 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:36.174659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1da98-8e55-46a1-9c39-b3e6cdcfc897 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:36.174977 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1da98-8e55-46a1-9c39-b3e6cdcfc897 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:36.186673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1da98-8e55-46a1-9c39-b3e6cdcfc897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f3f1da98-8e55-46a1-9c39-b3e6cdcfc897 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:36.196086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:36.197226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:36.198247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:36.202631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 628/1249] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:36.203692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d877970-b5c6-46ee-aea0-0c30bc1598ee None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:36.308512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d877970-b5c6-46ee-aea0-0c30bc1598ee None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:36.339771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:36.346664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:36.347412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:36.347755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:36.348500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:36.349638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:36.349959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:36.351957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:36.363627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 622/1250] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:36.369366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1da98-8e55-46a1-9c39-b3e6cdcfc897 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:36.454690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:36.479622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1da98-8e55-46a1-9c39-b3e6cdcfc897 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:36.517550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:36.518416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:36.518708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:36.519105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:36.532202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:36.534034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:36.553028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:36.554172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:36.555250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:36.555250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:36.555250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:36.555250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:36.555250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 629/1251] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:36.560865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:36.681836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2004-cb14-440d-8c0b-02c78be06dfd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:36.720180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:36.720776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:36.721060 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:36.721340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:36.722059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:36.722365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:36.723756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:36.735478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 623/1252] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:36.741723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:36.852668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623f5fd-ee84-4309-9ba5-b18944a3b185 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:36.881753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:36.891024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:36.891847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:36.892167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:36.892418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:36.900876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:36.902333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:23:36.918408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:36.919652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:36.920587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 630/1253] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:36.925671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:36.989818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:37.041959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0ef2d-d190-4dd1-9893-6d6c950e0740 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:37.083194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:37.083887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:37.084204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:37.084487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:37.085325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:37.085635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:37.087136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:37.107393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 624/1254] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jul 12 14:23:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:23:37.113241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:37.214346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195f8e-19c9-41e1-a663-dbe1399b9056 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:37.250909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5eff-8e77-400c-b7aa-2525e952df58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:37.251560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5eff-8e77-400c-b7aa-2525e952df58 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:37.251846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5eff-8e77-400c-b7aa-2525e952df58 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:37.252186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5eff-8e77-400c-b7aa-2525e952df58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:37.308303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:37.321206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5eff-8e77-400c-b7aa-2525e952df58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:37.322932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5eff-8e77-400c-b7aa-2525e952df58 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:37.425392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 631/1255] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:37.431515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:37.543848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e1ad6-460e-4062-adb0-2ff2d0de735e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:37.560236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:37.591356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:37.592273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:37.592597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:37.592914 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:37.604471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:37.606022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:37.625832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:37.626962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:37.633400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:37.633400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:37.633400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:37.633400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:37.633400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 625/1256] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:37.633683 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5eff-8e77-400c-b7aa-2525e952df58 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:37.729631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:37.743615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5eff-8e77-400c-b7aa-2525e952df58 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:37.779424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:37.780135 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:37.780478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:37.780789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:37.781579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:37.781916 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:37.783453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:37.796273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 632/1257] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:23:37.802152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:37.914450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff495a7-a8e9-4446-835c-9b024c3b8f52 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:37.957889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:37.958754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:37.959070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:37.959403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:37.966597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:37.968181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:23:37.983409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:37.984386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:37.985531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 626/1258] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:37.991692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:38.098952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccdabc-25e1-435b-bfb2-6b44e9f7a675 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:38.134544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b5e17-ca35-4604-bc41-e71b00450cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:38.135253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5e17-ca35-4604-bc41-e71b00450cec None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:38.135538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5e17-ca35-4604-bc41-e71b00450cec None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:38.135812 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5e17-ca35-4604-bc41-e71b00450cec None admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:38.136608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5e17-ca35-4604-bc41-e71b00450cec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:38.136919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5e17-ca35-4604-bc41-e71b00450cec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:38.138377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5e17-ca35-4604-bc41-e71b00450cec None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:38.152193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 633/1259] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:38.158339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:38.186287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:38.264112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de898b-02fa-4056-8a3c-f111a6ed7130 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:38.299592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f672c0a-e1dc-4ae7-b65e-e152605f792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:38.300269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672c0a-e1dc-4ae7-b65e-e152605f792e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:38.300555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672c0a-e1dc-4ae7-b65e-e152605f792e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:38.300829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672c0a-e1dc-4ae7-b65e-e152605f792e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:38.301668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f672c0a-e1dc-4ae7-b65e-e152605f792e None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=f63e307bc2f445dbaa67aac26dadbb64) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:38.301976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f672c0a-e1dc-4ae7-b65e-e152605f792e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:38.303512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f672c0a-e1dc-4ae7-b65e-e152605f792e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:38.309873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 627/1260] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:23:38 2022] GET /identity/v3/role_assignments?user.id=f63e307bc2f445dbaa67aac26dadbb64&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:40.278827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7809-902e-4269-9737-b16338a1543e None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:40.279339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7809-902e-4269-9737-b16338a1543e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:40.279427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7809-902e-4269-9737-b16338a1543e None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:40.280748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 634/1261] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:40.285971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a01837-5f58-44ed-b0fd-fc9982cbcf47 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:40.286393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a01837-5f58-44ed-b0fd-fc9982cbcf47 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:40.286544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a01837-5f58-44ed-b0fd-fc9982cbcf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:40.304010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a6a01837-5f58-44ed-b0fd-fc9982cbcf47 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:40.305187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a6a01837-5f58-44ed-b0fd-fc9982cbcf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:40.368808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 628/1262] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:40.390224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f7809-902e-4269-9737-b16338a1543e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:40.401536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:40.488358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f7809-902e-4269-9737-b16338a1543e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:40.519777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eceb8-92b8-4c55-86ea-0e64165c17b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:40.520554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eceb8-92b8-4c55-86ea-0e64165c17b7 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:40.520841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eceb8-92b8-4c55-86ea-0e64165c17b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:40.521116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eceb8-92b8-4c55-86ea-0e64165c17b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:40.531507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eceb8-92b8-4c55-86ea-0e64165c17b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-7e9eceb8-92b8-4c55-86ea-0e64165c17b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:40.539576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:40.540648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:40.541610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 635/1263] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:23:40.546598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a01837-5f58-44ed-b0fd-fc9982cbcf47 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:40.564217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:40.642268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a01837-5f58-44ed-b0fd-fc9982cbcf47 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:40.675205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:40.675872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:40.676159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:40.676440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:40.677180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:40.677488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:40.679395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:40.687212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 629/1264] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:40.692685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eceb8-92b8-4c55-86ea-0e64165c17b7 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:40.757596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:40.790403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eceb8-92b8-4c55-86ea-0e64165c17b7 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:40.822228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:40.823029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:40.823315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:40.823591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:40.833588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:40.835059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:40.852203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:40.853137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:40.854024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:40.854024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:40.854024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:40.854024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:40.854024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 636/1265] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:40.859891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:40.945362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:40.964352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9061131-2445-4cb3-aed6-2ee699af5a66 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:40.996024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:40.996689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:40.996978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:40.997256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:40.997973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:40.998280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:40.999659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:41.011454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 630/1266] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:41.017247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:41.114499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43bd7-5726-4092-805f-53af89aa5a55 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:41.134263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:41.148105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:41.148913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:41.149205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:41.149488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:41.157767 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:41.159248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:23:41.173191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:41.174268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:41.175609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 637/1267] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:41.180577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:41.276872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45d4ac-e8f0-4f73-90ee-1a764d2b1b65 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:41.309212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:41.309876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:41.310168 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:41.310448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:41.311308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:41.311621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:41.313031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:41.321833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:41.330050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 631/1268] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jul 12 14:23:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:41.335560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:41.432127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34baf4-3f2c-4835-a54d-8388a170ff7f None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:41.464332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:41.465109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:41.465398 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:41.465677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:41.476443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:41.477951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:41.495138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:41.496127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:41.497227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:41.497227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:41.497227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:41.497227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:41.497227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 638/1269] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:41.501712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:41.597706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb1396-4d94-4754-8f2c-0d666a8e2d54 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:41.630553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:41.631262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:41.631550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:41.631830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:41.632544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:41.632850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:41.634196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:41.644889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 632/1270] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:41.650838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:41.682121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:41.747594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03a41-cdfd-41a6-9ab4-4624f759e0b4 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:41.779089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:41.779870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:41.780158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:41.780436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:41.786891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:41.788830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:23:41.803500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:41.804417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:41.805446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 639/1271] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:41.810386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:41.869706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:41.916032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ea49-f2f5-403b-a6cd-1d63ad0d304a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:41.947677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471d98-981c-4d4b-a75f-470a7d7e010b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:41.948344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471d98-981c-4d4b-a75f-470a7d7e010b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:41.948633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471d98-981c-4d4b-a75f-470a7d7e010b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:41.948912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471d98-981c-4d4b-a75f-470a7d7e010b None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:41.949692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471d98-981c-4d4b-a75f-470a7d7e010b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:41.950003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471d98-981c-4d4b-a75f-470a7d7e010b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:41.951452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471d98-981c-4d4b-a75f-470a7d7e010b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:41.963819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 633/1272] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:41.969851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:42.057604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:42.066721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af4004-5e84-4a7e-adbe-01dda065c732 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:42.100685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c5a57-75fc-4583-a1d8-3d005b9b8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:42.101571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c5a57-75fc-4583-a1d8-3d005b9b8931 None admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:42.101859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c5a57-75fc-4583-a1d8-3d005b9b8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:42.102143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c5a57-75fc-4583-a1d8-3d005b9b8931 None admin] PATH_INFO: `/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/f63e307bc2f445dbaa67aac26dadbb64/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:42.104277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c5a57-75fc-4583-a1d8-3d005b9b8931 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636ac1b7e8a43c99327013ee2511995, user_id=f63e307bc2f445dbaa67aac26dadbb64, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:42.105722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c5a57-75fc-4583-a1d8-3d005b9b8931 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:42.118620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 640/1273] 10.222.0.72 () {58 vars in 1439 bytes} [Tue Jul 12 14:23:41 2022] PUT /identity/v3/projects/d636ac1b7e8a43c99327013ee2511995/users/f63e307bc2f445dbaa67aac26dadbb64/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:23:44.123485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fba51d-86f4-48d8-ad75-c16b44f84300 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:44.123935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fba51d-86f4-48d8-ad75-c16b44f84300 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:44.124045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fba51d-86f4-48d8-ad75-c16b44f84300 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:44.125424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 634/1274] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:44.130485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74de3e-cc21-4196-a9bc-fff769f9eae3 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:44.130935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74de3e-cc21-4196-a9bc-fff769f9eae3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:44.131090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74de3e-cc21-4196-a9bc-fff769f9eae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:44.148400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1a74de3e-cc21-4196-a9bc-fff769f9eae3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:44.149566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1a74de3e-cc21-4196-a9bc-fff769f9eae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:44.212767 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 641/1275] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:44.235717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fba51d-86f4-48d8-ad75-c16b44f84300 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:44.333385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fba51d-86f4-48d8-ad75-c16b44f84300 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:44.350737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:44.367445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681691-9c1c-44b3-8a58-c68fde36933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:44.368230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681691-9c1c-44b3-8a58-c68fde36933b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:44.368520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681691-9c1c-44b3-8a58-c68fde36933b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:44.368799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681691-9c1c-44b3-8a58-c68fde36933b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:44.378654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03681691-9c1c-44b3-8a58-c68fde36933b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-03681691-9c1c-44b3-8a58-c68fde36933b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:44.386368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:44.387452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:44.388299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 635/1276] 10.222.0.72 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:44.393272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74de3e-cc21-4196-a9bc-fff769f9eae3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:44.471091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:44.489867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74de3e-cc21-4196-a9bc-fff769f9eae3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:44.523971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:44.524636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:44.524927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:44.525208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:44.526224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:44.526537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:44.527949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:44.535769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 642/1277] 10.222.0.72 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:44.541254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681691-9c1c-44b3-8a58-c68fde36933b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:44.637309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681691-9c1c-44b3-8a58-c68fde36933b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:44.669831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:44.670611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:44.670931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:44.671216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:44.681423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:44.683924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:44.701045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:44.702056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:44.703001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:44.703001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:44.703001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:44.703001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:44.703001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 636/1278] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:44.707674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:44.803386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bd3e7-9ab9-4dfc-8145-0ee356085209 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:44.835914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:44.836570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:44.836854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:44.837133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:44.837844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:44.838159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:44.839544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:44.851925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 643/1279] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:44.857833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:44.889252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:44.955522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85999c-4dde-48f8-aa25-f40f506c2c1e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:44.986706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:44.987518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:44.987805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:44.988081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:44.996425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:44.997846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:23:45.012218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:45.013296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:45.014428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 637/1280] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:45.019143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:45.022934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:45.115710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4ab9-a8d9-455c-af90-f56a61cf1866 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:45.147455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:45.148118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:45.148403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:45.148681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:45.149508 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:45.149816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:45.151567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:45.167710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 644/1281] 10.222.0.72 () {56 vars in 1143 bytes} [Tue Jul 12 14:23:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:45.173365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:45.260361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:45.269867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63da7-5088-4623-b270-8835d88a06c8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:45.302180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94fb05-d05c-49dc-8cab-45466beb887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:45.303448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94fb05-d05c-49dc-8cab-45466beb887b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:45.303732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94fb05-d05c-49dc-8cab-45466beb887b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:45.304007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94fb05-d05c-49dc-8cab-45466beb887b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:45.367938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94fb05-d05c-49dc-8cab-45466beb887b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:45.369351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94fb05-d05c-49dc-8cab-45466beb887b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:45.452576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:45.462575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 638/1282] 10.222.0.72 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:45.468170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:45.526598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:45.563576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77d70-5594-4fe8-b526-654a1da915ed None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:45.595670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:45.596452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:45.596742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:45.597020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:45.607305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:45.608746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:45.626090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:45.627150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:45.628157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:23:45.628157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:45.628157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:23:45.628157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:45.628157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 645/1283] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:45.633490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94fb05-d05c-49dc-8cab-45466beb887b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:45.729151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94fb05-d05c-49dc-8cab-45466beb887b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:45.762513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:45.763192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:45.763484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:45.763766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:45.764484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:45.764794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:45.766148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:45.777313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 639/1284] 10.222.0.72 () {56 vars in 1109 bytes} [Tue Jul 12 14:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:45.782592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:45.878545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd3f48-be53-4f5b-bf8c-d5ee6409976b None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:45.892821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:45.912627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:45.913416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:45.913704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:45.913985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:45.920421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:45.921870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:23:45.935792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:45.936794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: ERROR keystone.server.flask.application Jul 12 14:23:45.942476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 646/1285] 10.222.0.72 () {56 vars in 1111 bytes} [Tue Jul 12 14:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:45.943120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:45.992405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:46.040122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27a9fc-321f-4d5f-86b8-b7f50e451739 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:46.074096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9123-6d84-4984-9568-3c0b0216b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:46.074785 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9123-6d84-4984-9568-3c0b0216b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:46.075087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9123-6d84-4984-9568-3c0b0216b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:46.075375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9123-6d84-4984-9568-3c0b0216b7a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:46.076166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9123-6d84-4984-9568-3c0b0216b7a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:46.076483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9123-6d84-4984-9568-3c0b0216b7a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:46.077910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9123-6d84-4984-9568-3c0b0216b7a5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:46.089723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 640/1286] 10.222.0.72 () {56 vars in 1148 bytes} [Tue Jul 12 14:23:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:46.095619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:46.192643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d3dab-374f-4593-973b-f5183dc8f945 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:46.223734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02243799-f58a-4e7a-97df-9a44d31befd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:46.224374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02243799-f58a-4e7a-97df-9a44d31befd9 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:46.224659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02243799-f58a-4e7a-97df-9a44d31befd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:46.224937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02243799-f58a-4e7a-97df-9a44d31befd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:46.226278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02243799-f58a-4e7a-97df-9a44d31befd9 None admin] RBAC: Adding query filter params (role.id=a684d812bd0e4947bda85bee1f00b8f5, scope.project.id=d636ac1b7e8a43c99327013ee2511995, user.id=f63e307bc2f445dbaa67aac26dadbb64) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:46.226602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02243799-f58a-4e7a-97df-9a44d31befd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:46.228046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02243799-f58a-4e7a-97df-9a44d31befd9 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:46.233639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 647/1287] 10.222.0.72 () {56 vars in 1374 bytes} [Tue Jul 12 14:23:46 2022] GET /identity/v3/role_assignments?user.id=f63e307bc2f445dbaa67aac26dadbb64&scope.project.id=d636ac1b7e8a43c99327013ee2511995&role.id=a684d812bd0e4947bda85bee1f00b8f5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:48.274122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22d86-4510-4150-825d-ab94bc4583d9 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:48.274671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22d86-4510-4150-825d-ab94bc4583d9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:48.274671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22d86-4510-4150-825d-ab94bc4583d9 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:48.276349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 641/1288] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:48.281393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17dfc-8520-4279-90fb-e7a3f66cb9fb None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:48.281782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17dfc-8520-4279-90fb-e7a3f66cb9fb None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:48.281962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17dfc-8520-4279-90fb-e7a3f66cb9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:48.298669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-35d17dfc-8520-4279-90fb-e7a3f66cb9fb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:48.299874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-35d17dfc-8520-4279-90fb-e7a3f66cb9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:48.328419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:48.365010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 648/1289] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:48.387015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f22d86-4510-4150-825d-ab94bc4583d9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:48.484879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f22d86-4510-4150-825d-ab94bc4583d9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:48.496217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:48.518479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:48.519302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:48.519589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:48.519865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:48.520506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:48.521860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:48.533578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:48.534818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:48.536043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 642/1290] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:23:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:48.541112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17dfc-8520-4279-90fb-e7a3f66cb9fb None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:48.636487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17dfc-8520-4279-90fb-e7a3f66cb9fb None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:48.669735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79535316-2664-4075-9ed9-58d8a657991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:48.670394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535316-2664-4075-9ed9-58d8a657991b None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:48.670679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535316-2664-4075-9ed9-58d8a657991b None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:48.670990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535316-2664-4075-9ed9-58d8a657991b None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:48.671688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79535316-2664-4075-9ed9-58d8a657991b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:48.671993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79535316-2664-4075-9ed9-58d8a657991b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:48.673358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79535316-2664-4075-9ed9-58d8a657991b None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:48.678025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 649/1291] 10.222.0.72 () {56 vars in 1116 bytes} [Tue Jul 12 14:23:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:48.683817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:48.780309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b371b-30d2-4bf9-9f84-da9d3dcc3040 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:48.812410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2bb8f-e6c2-43ef-b73d-51b71fd97bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:48.813065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2bb8f-e6c2-43ef-b73d-51b71fd97bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:48.813350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2bb8f-e6c2-43ef-b73d-51b71fd97bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:48.813629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2bb8f-e6c2-43ef-b73d-51b71fd97bf7 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:48.814329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2bb8f-e6c2-43ef-b73d-51b71fd97bf7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:48.814637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2bb8f-e6c2-43ef-b73d-51b71fd97bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:48.816040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2bb8f-e6c2-43ef-b73d-51b71fd97bf7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:48.820345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 643/1292] 10.222.0.72 () {56 vars in 1116 bytes} [Tue Jul 12 14:23:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:50.803233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7b5a-7a65-475d-9a10-52c403f7d968 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:50.803788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7b5a-7a65-475d-9a10-52c403f7d968 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:50.803788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7b5a-7a65-475d-9a10-52c403f7d968 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:50.805858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 650/1293] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:50.810977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588ca56-d432-4f01-99aa-33a1344ebcda None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:50.811410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588ca56-d432-4f01-99aa-33a1344ebcda None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:50.811546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588ca56-d432-4f01-99aa-33a1344ebcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:50.827682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7588ca56-d432-4f01-99aa-33a1344ebcda None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:50.828851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7588ca56-d432-4f01-99aa-33a1344ebcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:50.859664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:50.901678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 644/1294] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:50.927303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e7b5a-7a65-475d-9a10-52c403f7d968 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:50.957372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:51.026166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e7b5a-7a65-475d-9a10-52c403f7d968 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:51.059392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ed96c-9b6f-481e-9929-8c1ff66290db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:51.059995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed96c-9b6f-481e-9929-8c1ff66290db None admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:51.060286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed96c-9b6f-481e-9929-8c1ff66290db None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:51.060568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed96c-9b6f-481e-9929-8c1ff66290db None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:51.061294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ed96c-9b6f-481e-9929-8c1ff66290db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:51.063182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ed96c-9b6f-481e-9929-8c1ff66290db None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:51.075109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 651/1295] 10.222.0.72 () {60 vars in 1141 bytes} [Tue Jul 12 14:23:50 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:23:53.068270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07c5b-112f-43f0-bf10-d15915ef6886 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:53.068668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07c5b-112f-43f0-bf10-d15915ef6886 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:53.068847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07c5b-112f-43f0-bf10-d15915ef6886 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:53.070275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 645/1296] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:53.075236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a416ea-effe-4a58-afda-253add89c5d3 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:53.075658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a416ea-effe-4a58-afda-253add89c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:53.075807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a416ea-effe-4a58-afda-253add89c5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:53.092594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-08a416ea-effe-4a58-afda-253add89c5d3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:53.093777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-08a416ea-effe-4a58-afda-253add89c5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:53.164064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 652/1297] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:53.186617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde07c5b-112f-43f0-bf10-d15915ef6886 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:53.285187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde07c5b-112f-43f0-bf10-d15915ef6886 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:53.317745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:53.318480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:53.318800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:53.319078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:53.319771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:53.321117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:53.332657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:53.333875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:53.335139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 646/1298] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:23:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:53.340133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a416ea-effe-4a58-afda-253add89c5d3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:53.358359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:53.436082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a416ea-effe-4a58-afda-253add89c5d3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:53.468999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:53.469662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:53.469951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:53.470232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:53.470967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:53.471294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:53.472700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:53.477676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 653/1299] 10.222.0.72 () {56 vars in 1116 bytes} [Tue Jul 12 14:23:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:53.483449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:53.513927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:53.580267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce017d4-2442-4962-8e0c-132893ebeb80 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:53.612418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ab436-a4f8-4d53-923c-1da71a53478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:53.613068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ab436-a4f8-4d53-923c-1da71a53478c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:53.613354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ab436-a4f8-4d53-923c-1da71a53478c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:53.613631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ab436-a4f8-4d53-923c-1da71a53478c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:53.614748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ab436-a4f8-4d53-923c-1da71a53478c None admin] RBAC: Adding query filter params (interface=public, service_id=25b3ea4d4ab74c32b4ec07e4a7c60167, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:53.615120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ab436-a4f8-4d53-923c-1da71a53478c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:53.616513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ab436-a4f8-4d53-923c-1da71a53478c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:53.621477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 647/1300] 10.222.0.72 () {56 vars in 1251 bytes} [Tue Jul 12 14:23:53 2022] GET /identity/v3/endpoints?service_id=25b3ea4d4ab74c32b4ec07e4a7c60167&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:53.627053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:53.706949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:53.725119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4a595-03ae-4e8f-b37e-b3777a3f0f28 None admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:53.756762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831f911-c500-4eb2-816f-a8319d0d1b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:53.757913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f911-c500-4eb2-816f-a8319d0d1b7c None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:53.758195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f911-c500-4eb2-816f-a8319d0d1b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:53.758469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f911-c500-4eb2-816f-a8319d0d1b7c None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:53.759173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831f911-c500-4eb2-816f-a8319d0d1b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:53.760539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831f911-c500-4eb2-816f-a8319d0d1b7c None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:53.767302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 654/1301] 10.222.0.72 () {56 vars in 1087 bytes} [Tue Jul 12 14:23:53 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:23:55.759736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a0fa-4fe2-4853-8e75-371a31e5257b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:55.760268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a0fa-4fe2-4853-8e75-371a31e5257b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:55.760268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a0fa-4fe2-4853-8e75-371a31e5257b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:55.761650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 648/1302] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:55.766753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e43596-d9bd-4157-93a9-b465f4d043b0 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:55.767146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e43596-d9bd-4157-93a9-b465f4d043b0 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:55.767351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e43596-d9bd-4157-93a9-b465f4d043b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:55.783986 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-12e43596-d9bd-4157-93a9-b465f4d043b0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:55.785168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-12e43596-d9bd-4157-93a9-b465f4d043b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:55.849571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 655/1303] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:55.876922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a0fa-4fe2-4853-8e75-371a31e5257b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:55.968204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:55.975146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a0fa-4fe2-4853-8e75-371a31e5257b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:56.008101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:56.008891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:56.009172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:56.009448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:56.010137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:56.011462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:56.023034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:56.024164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: ERROR keystone.server.flask.application Jul 12 14:23:56.025006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 649/1304] 10.222.0.72 () {56 vars in 1117 bytes} [Tue Jul 12 14:23:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:56.030470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e43596-d9bd-4157-93a9-b465f4d043b0 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:56.104594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:56.127105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e43596-d9bd-4157-93a9-b465f4d043b0 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:56.159948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184eaa4-0e6d-4fe2-be79-30b01c6be150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:56.160613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184eaa4-0e6d-4fe2-be79-30b01c6be150 None admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:56.160900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184eaa4-0e6d-4fe2-be79-30b01c6be150 None admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:56.161179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184eaa4-0e6d-4fe2-be79-30b01c6be150 None admin] PATH_INFO: `/v3/services` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:56.161882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184eaa4-0e6d-4fe2-be79-30b01c6be150 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:56.162193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184eaa4-0e6d-4fe2-be79-30b01c6be150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:56.164201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184eaa4-0e6d-4fe2-be79-30b01c6be150 None admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:56.169213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 656/1305] 10.222.0.72 () {56 vars in 1116 bytes} [Tue Jul 12 14:23:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:56.174971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:56.270297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee63e2-61ed-49fb-a3ed-71109aac6b61 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:56.302885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bc700-d8dc-446c-8530-f8f5776f5a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:56.303524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc700-d8dc-446c-8530-f8f5776f5a72 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:56.303809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc700-d8dc-446c-8530-f8f5776f5a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:56.304115 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc700-d8dc-446c-8530-f8f5776f5a72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:56.304854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bc700-d8dc-446c-8530-f8f5776f5a72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:56.306184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bc700-d8dc-446c-8530-f8f5776f5a72 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:56.323462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 650/1306] 10.222.0.72 () {60 vars in 1144 bytes} [Tue Jul 12 14:23:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:24:06.166199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=30 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:06.319659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:58.684867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265da49-a487-4090-ab02-fa5ebdf7cdef None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:58.685446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265da49-a487-4090-ab02-fa5ebdf7cdef None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:58.685446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265da49-a487-4090-ab02-fa5ebdf7cdef None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:58.690648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 657/1307] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:24:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:24:58.692274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695e822-134a-456f-bd17-59176238b217 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:58.693041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695e822-134a-456f-bd17-59176238b217 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:58.693327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695e822-134a-456f-bd17-59176238b217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:58.854114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9695e822-134a-456f-bd17-59176238b217 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:24:58.857455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9695e822-134a-456f-bd17-59176238b217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:24:59.110874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 651/1308] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:24:59.150714 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d18d1-d80a-4eca-afeb-350f2e913592 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:59.151351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d18d1-d80a-4eca-afeb-350f2e913592 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:59.151779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d18d1-d80a-4eca-afeb-350f2e913592 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:59.154266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 658/1309] 10.222.0.72 () {54 vars in 964 bytes} [Tue Jul 12 14:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:24:59.160371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da583fd-9368-4082-9c69-7eec6ccd2ddc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:59.160910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da583fd-9368-4082-9c69-7eec6ccd2ddc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:59.161302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da583fd-9368-4082-9c69-7eec6ccd2ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:59.250280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9da583fd-9368-4082-9c69-7eec6ccd2ddc None None] MFA Rules not processed for user `18d55b1fd69640548e7b35258e33e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:24:59.251582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9da583fd-9368-4082-9c69-7eec6ccd2ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:24:59.277146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:59.356364 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 652/1310] 10.222.0.72 () {58 vars in 1061 bytes} [Tue Jul 12 14:24:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:24:59.365370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d18d1-d80a-4eca-afeb-350f2e913592 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:59.367191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-bf2d18d1-d80a-4eca-afeb-350f2e913592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:24:59.502301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d18d1-d80a-4eca-afeb-350f2e913592 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:59.586413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03a714-9211-4fcb-9c07-b52033396f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:59.587513 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03a714-9211-4fcb-9c07-b52033396f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:59.588024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03a714-9211-4fcb-9c07-b52033396f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:59.588645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03a714-9211-4fcb-9c07-b52033396f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:59.590585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ed03a714-9211-4fcb-9c07-b52033396f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:24:59.654455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:59.719554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03a714-9211-4fcb-9c07-b52033396f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:59.721794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03a714-9211-4fcb-9c07-b52033396f1e service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:59.755244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 659/1311] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:25:02.106693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ed4d-c347-41d2-88fd-598dd3eea1ea None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:02.107235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ed4d-c347-41d2-88fd-598dd3eea1ea None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:02.107321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ed4d-c347-41d2-88fd-598dd3eea1ea None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:02.108678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 653/1312] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:02.114000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558448-6a6f-45a0-a444-687910711e63 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:02.114447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558448-6a6f-45a0-a444-687910711e63 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:02.114597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558448-6a6f-45a0-a444-687910711e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:02.185112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-2e558448-6a6f-45a0-a444-687910711e63 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:02.186307 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2e558448-6a6f-45a0-a444-687910711e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:02.284535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 660/1313] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:02.324772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ed4d-c347-41d2-88fd-598dd3eea1ea None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:02.326381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8287ed4d-c347-41d2-88fd-598dd3eea1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:02.439428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ed4d-c347-41d2-88fd-598dd3eea1ea None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:02.516010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:02.518629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd541854-eabe-4ca4-9ecd-c22b1d54eca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:02.519565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd541854-eabe-4ca4-9ecd-c22b1d54eca6 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:02.520084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd541854-eabe-4ca4-9ecd-c22b1d54eca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:02.520595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd541854-eabe-4ca4-9ecd-c22b1d54eca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:02.522254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fd541854-eabe-4ca4-9ecd-c22b1d54eca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:02.630948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd541854-eabe-4ca4-9ecd-c22b1d54eca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:02.632351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd541854-eabe-4ca4-9ecd-c22b1d54eca6 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:02.651977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 654/1314] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:04.965391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4039d-b2cf-41b2-8f7d-749cb0db8179 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:04.965972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4039d-b2cf-41b2-8f7d-749cb0db8179 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:04.965972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4039d-b2cf-41b2-8f7d-749cb0db8179 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:04.967378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 661/1315] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:04.972449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c34a0-6ce6-4656-96fc-88e4ae821e45 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:04.972867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c34a0-6ce6-4656-96fc-88e4ae821e45 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:04.973008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c34a0-6ce6-4656-96fc-88e4ae821e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:05.035927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5f7c34a0-6ce6-4656-96fc-88e4ae821e45 None None] MFA Rules not processed for user `4d27a9d64e924ced8ab73b7b339ccdcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:05.037042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5f7c34a0-6ce6-4656-96fc-88e4ae821e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:05.091158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:05.134264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 655/1316] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:05.173382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4039d-b2cf-41b2-8f7d-749cb0db8179 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:05.174964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d4f4039d-b2cf-41b2-8f7d-749cb0db8179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:05.184709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:05.275836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4039d-b2cf-41b2-8f7d-749cb0db8179 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:05.347993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4a628-237e-4c18-8521-60baa1c52f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:05.348576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a628-237e-4c18-8521-60baa1c52f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:05.348862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a628-237e-4c18-8521-60baa1c52f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:05.349142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a628-237e-4c18-8521-60baa1c52f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:05.350763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fbb4a628-237e-4c18-8521-60baa1c52f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:05.410692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:05.457202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4a628-237e-4c18-8521-60baa1c52f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:05.458655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4a628-237e-4c18-8521-60baa1c52f9d service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:05.478235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 662/1317] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:08.048704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c74f-2207-4929-8e69-fc1e60e639db None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:08.049234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c74f-2207-4929-8e69-fc1e60e639db None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:08.049352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c74f-2207-4929-8e69-fc1e60e639db None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:08.050644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 656/1318] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:08.055764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1b42-edab-4c18-bd9b-5f0be4a3fcc0 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:08.056143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1b42-edab-4c18-bd9b-5f0be4a3fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:08.056372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1b42-edab-4c18-bd9b-5f0be4a3fcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:08.118644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a3dd1b42-edab-4c18-bd9b-5f0be4a3fcc0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:08.119891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a3dd1b42-edab-4c18-bd9b-5f0be4a3fcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:08.227990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 663/1319] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:08.265552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c74f-2207-4929-8e69-fc1e60e639db None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:08.267154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e332c74f-2207-4929-8e69-fc1e60e639db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:08.370946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c74f-2207-4929-8e69-fc1e60e639db None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:08.441072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65298a-2b8b-41e5-a594-c60baa9d28bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:08.441719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65298a-2b8b-41e5-a594-c60baa9d28bc service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:08.442004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65298a-2b8b-41e5-a594-c60baa9d28bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:08.442278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65298a-2b8b-41e5-a594-c60baa9d28bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:08.443968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9c65298a-2b8b-41e5-a594-c60baa9d28bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:08.451631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:08.549161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65298a-2b8b-41e5-a594-c60baa9d28bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:08.550582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65298a-2b8b-41e5-a594-c60baa9d28bc service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:08.568297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 657/1320] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:11.248253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e368c-9c68-4d07-9360-76864433b439 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:11.248775 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e368c-9c68-4d07-9360-76864433b439 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:11.248889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e368c-9c68-4d07-9360-76864433b439 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:11.250193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 664/1321] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:11.255482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235eadb-076c-48db-bf16-ff1932d44519 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:11.255928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235eadb-076c-48db-bf16-ff1932d44519 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:11.256181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235eadb-076c-48db-bf16-ff1932d44519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:11.321730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c235eadb-076c-48db-bf16-ff1932d44519 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:11.323432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c235eadb-076c-48db-bf16-ff1932d44519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:11.385536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:11.429662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 658/1322] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:11.466255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e368c-9c68-4d07-9360-76864433b439 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:11.467840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-788e368c-9c68-4d07-9360-76864433b439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:11.488457 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:11.577866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e368c-9c68-4d07-9360-76864433b439 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:11.653023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487ca8a-1bec-49e8-9e10-62ce69df2d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:11.653686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ca8a-1bec-49e8-9e10-62ce69df2d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:11.653998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ca8a-1bec-49e8-9e10-62ce69df2d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:11.654278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487ca8a-1bec-49e8-9e10-62ce69df2d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:11.656221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e487ca8a-1bec-49e8-9e10-62ce69df2d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:11.724990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:11.761819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487ca8a-1bec-49e8-9e10-62ce69df2d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:11.763310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487ca8a-1bec-49e8-9e10-62ce69df2d54 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:11.782068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 665/1323] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:13.864286 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6a6c-ab7d-4d94-ad9e-4183d4124e3e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:13.864791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6a6c-ab7d-4d94-ad9e-4183d4124e3e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:13.864791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6a6c-ab7d-4d94-ad9e-4183d4124e3e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:13.866189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 659/1324] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:13.872114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3abd17-a18a-4b5b-a3c7-eb89136ad63e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:13.872499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3abd17-a18a-4b5b-a3c7-eb89136ad63e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:13.872677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3abd17-a18a-4b5b-a3c7-eb89136ad63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:13.942390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7c3abd17-a18a-4b5b-a3c7-eb89136ad63e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:13.943619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7c3abd17-a18a-4b5b-a3c7-eb89136ad63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:14.038955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 666/1325] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:14.074567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b6a6c-ab7d-4d94-ad9e-4183d4124e3e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:14.076147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-984b6a6c-ab7d-4d94-ad9e-4183d4124e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:14.179918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b6a6c-ab7d-4d94-ad9e-4183d4124e3e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:14.252595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0eee4-123d-45e2-bb95-b9256bafa3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:14.253261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0eee4-123d-45e2-bb95-b9256bafa3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:14.253552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0eee4-123d-45e2-bb95-b9256bafa3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:14.253834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0eee4-123d-45e2-bb95-b9256bafa3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:14.255581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-73b0eee4-123d-45e2-bb95-b9256bafa3a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:14.273918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:14.368631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0eee4-123d-45e2-bb95-b9256bafa3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:14.370105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0eee4-123d-45e2-bb95-b9256bafa3a2 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:14.388287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 660/1326] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:16.436931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc4aa-53df-49bb-9a5b-4af7bcb3812a None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:16.437464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc4aa-53df-49bb-9a5b-4af7bcb3812a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:16.437557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc4aa-53df-49bb-9a5b-4af7bcb3812a None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:16.439020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 667/1327] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:16.444183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf66096-f811-4676-8409-00e682d753f1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:16.444604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf66096-f811-4676-8409-00e682d753f1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:16.444754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf66096-f811-4676-8409-00e682d753f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:16.508732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6cf66096-f811-4676-8409-00e682d753f1 None None] MFA Rules not processed for user `4d27a9d64e924ced8ab73b7b339ccdcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:16.509971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6cf66096-f811-4676-8409-00e682d753f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:16.575488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:16.609643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 661/1328] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:16.646700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc4aa-53df-49bb-9a5b-4af7bcb3812a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:16.648576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-569dc4aa-53df-49bb-9a5b-4af7bcb3812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:16.681281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:16.759020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc4aa-53df-49bb-9a5b-4af7bcb3812a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:16.832637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63578a59-1a63-4a30-b8da-d383fe8af99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:16.833287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578a59-1a63-4a30-b8da-d383fe8af99b service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:16.833573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578a59-1a63-4a30-b8da-d383fe8af99b service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:16.833867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578a59-1a63-4a30-b8da-d383fe8af99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:16.835521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-63578a59-1a63-4a30-b8da-d383fe8af99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:16.914293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:16.946330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63578a59-1a63-4a30-b8da-d383fe8af99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:16.948376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63578a59-1a63-4a30-b8da-d383fe8af99b service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:16.967452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 668/1329] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:19.299786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca6db-761a-42ae-9da1-89c63bfcc442 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:19.300343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca6db-761a-42ae-9da1-89c63bfcc442 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:19.300440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca6db-761a-42ae-9da1-89c63bfcc442 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:19.301747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 662/1330] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:19.306941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a821a-d5c8-4c30-8223-a397182fcfb5 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:19.307363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a821a-d5c8-4c30-8223-a397182fcfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:19.307509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a821a-d5c8-4c30-8223-a397182fcfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:19.371715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-285a821a-d5c8-4c30-8223-a397182fcfb5 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:19.372920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-285a821a-d5c8-4c30-8223-a397182fcfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:19.467300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 669/1331] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:19.514997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5203-d1e7-4a49-9246-648f65a6f083 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:19.515297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5203-d1e7-4a49-9246-648f65a6f083 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:19.515587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5203-d1e7-4a49-9246-648f65a6f083 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:19.516975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 663/1332] 10.222.0.72 () {54 vars in 964 bytes} [Tue Jul 12 14:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:19.522524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a5ae-4924-4a1b-8230-3532659a96ce None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:19.522854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a5ae-4924-4a1b-8230-3532659a96ce None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:19.523143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a5ae-4924-4a1b-8230-3532659a96ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:19.566537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:19.596939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-3407a5ae-4924-4a1b-8230-3532659a96ce None None] MFA Rules not processed for user `18d55b1fd69640548e7b35258e33e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:19.598127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3407a5ae-4924-4a1b-8230-3532659a96ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:19.672181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 670/1333] 10.222.0.72 () {58 vars in 1061 bytes} [Tue Jul 12 14:25:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:25:19.681151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b5203-d1e7-4a49-9246-648f65a6f083 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:19.682784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0f0b5203-d1e7-4a49-9246-648f65a6f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:19.784591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b5203-d1e7-4a49-9246-648f65a6f083 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:19.858502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0803c7-0cea-4d5c-8645-969b0b8d51ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:19.859119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0803c7-0cea-4d5c-8645-969b0b8d51ca service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:19.859414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0803c7-0cea-4d5c-8645-969b0b8d51ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:19.859697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0803c7-0cea-4d5c-8645-969b0b8d51ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:19.861347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8b0803c7-0cea-4d5c-8645-969b0b8d51ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:19.888687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:19.969634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0803c7-0cea-4d5c-8645-969b0b8d51ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:19.971135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0803c7-0cea-4d5c-8645-969b0b8d51ca service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:19.988875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 664/1334] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:22.269531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9033-7185-4c6b-9e26-837cafb2c758 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:22.270122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9033-7185-4c6b-9e26-837cafb2c758 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:22.270533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9033-7185-4c6b-9e26-837cafb2c758 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:22.273272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 671/1335] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:22.279245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd98d2-dea7-4790-abc6-b11ba075d299 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:22.279656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd98d2-dea7-4790-abc6-b11ba075d299 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:22.279818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd98d2-dea7-4790-abc6-b11ba075d299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:22.343715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cacd98d2-dea7-4790-abc6-b11ba075d299 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:22.344841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cacd98d2-dea7-4790-abc6-b11ba075d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:22.417044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:22.438910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 665/1336] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:25:22.479535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9033-7185-4c6b-9e26-837cafb2c758 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:22.481083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4abb9033-7185-4c6b-9e26-837cafb2c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:22.581472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9033-7185-4c6b-9e26-837cafb2c758 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:22.609529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:22.652967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a5340-b9bd-415b-bc56-2277f1d158c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:22.653616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a5340-b9bd-415b-bc56-2277f1d158c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:22.653902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a5340-b9bd-415b-bc56-2277f1d158c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:22.654181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a5340-b9bd-415b-bc56-2277f1d158c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:22.656122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-497a5340-b9bd-415b-bc56-2277f1d158c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:22.762313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a5340-b9bd-415b-bc56-2277f1d158c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:22.763837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a5340-b9bd-415b-bc56-2277f1d158c0 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:22.782434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 672/1337] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:25.404965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f2c13-a486-4ff2-a6c7-500a5c530557 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:25.405502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f2c13-a486-4ff2-a6c7-500a5c530557 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:25.405876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f2c13-a486-4ff2-a6c7-500a5c530557 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:25.407234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 666/1338] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:25.412352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee170c9-70a0-4625-b27d-9a0b049e3637 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:25.412776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee170c9-70a0-4625-b27d-9a0b049e3637 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:25.412919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee170c9-70a0-4625-b27d-9a0b049e3637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:25.476034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-cee170c9-70a0-4625-b27d-9a0b049e3637 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:25.477301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-cee170c9-70a0-4625-b27d-9a0b049e3637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:25.486180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:25.574442 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 673/1339] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:25.609343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f2c13-a486-4ff2-a6c7-500a5c530557 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:25.610897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ce1f2c13-a486-4ff2-a6c7-500a5c530557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:25.712119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f2c13-a486-4ff2-a6c7-500a5c530557 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:25.787276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf2c95-6fe1-4a30-82b9-1304dbd6a08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:25.787937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2c95-6fe1-4a30-82b9-1304dbd6a08b service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:25.788223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2c95-6fe1-4a30-82b9-1304dbd6a08b service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:25.788504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2c95-6fe1-4a30-82b9-1304dbd6a08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:25.790142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d1cf2c95-6fe1-4a30-82b9-1304dbd6a08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:25.826434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:25.903485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf2c95-6fe1-4a30-82b9-1304dbd6a08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:25.904962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf2c95-6fe1-4a30-82b9-1304dbd6a08b service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:25.923315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 667/1340] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:29.850693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10919fbf-8023-4630-80d8-340b555581e6 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:29.851252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10919fbf-8023-4630-80d8-340b555581e6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:29.851252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10919fbf-8023-4630-80d8-340b555581e6 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:29.852591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 674/1341] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:29.859323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89b90e-6f1e-4db3-822b-f33fc1ef3283 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:29.859831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89b90e-6f1e-4db3-822b-f33fc1ef3283 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:29.859973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89b90e-6f1e-4db3-822b-f33fc1ef3283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:29.925769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0d89b90e-6f1e-4db3-822b-f33fc1ef3283 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:29.927013 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0d89b90e-6f1e-4db3-822b-f33fc1ef3283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:30.011161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:30.023282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 668/1342] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:30.064448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10919fbf-8023-4630-80d8-340b555581e6 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:30.066060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-10919fbf-8023-4630-80d8-340b555581e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:30.169178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10919fbf-8023-4630-80d8-340b555581e6 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:30.206570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:30.243666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e801564-f06f-4a6c-b979-958974a2158e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:30.244326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801564-f06f-4a6c-b979-958974a2158e service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:30.244614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801564-f06f-4a6c-b979-958974a2158e service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:30.244893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801564-f06f-4a6c-b979-958974a2158e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:30.246548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0e801564-f06f-4a6c-b979-958974a2158e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:30.355498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e801564-f06f-4a6c-b979-958974a2158e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:30.356956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e801564-f06f-4a6c-b979-958974a2158e service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:30.376243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 675/1343] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:33.050669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3113b-677c-4d68-93f8-9ef29c567a3a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:33.051216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3113b-677c-4d68-93f8-9ef29c567a3a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:33.051216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3113b-677c-4d68-93f8-9ef29c567a3a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:33.052613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 669/1344] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:33.059045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa16a9-24a2-435f-a2e9-67574b4920ac None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:33.059594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa16a9-24a2-435f-a2e9-67574b4920ac None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:33.059594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa16a9-24a2-435f-a2e9-67574b4920ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:33.126992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-0daa16a9-24a2-435f-a2e9-67574b4920ac None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:33.128216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0daa16a9-24a2-435f-a2e9-67574b4920ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:33.146732 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:33.225015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 676/1345] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:33.262701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3113b-677c-4d68-93f8-9ef29c567a3a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:33.264266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-96b3113b-677c-4d68-93f8-9ef29c567a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:33.369298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3113b-677c-4d68-93f8-9ef29c567a3a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:33.447443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda1353-f7be-4fbf-a3b2-3522e915db3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:33.448105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda1353-f7be-4fbf-a3b2-3522e915db3a service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:33.448396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda1353-f7be-4fbf-a3b2-3522e915db3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:33.448676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda1353-f7be-4fbf-a3b2-3522e915db3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:33.450323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4dda1353-f7be-4fbf-a3b2-3522e915db3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:33.493086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:33.562234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda1353-f7be-4fbf-a3b2-3522e915db3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:33.563709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda1353-f7be-4fbf-a3b2-3522e915db3a service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:33.583246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 670/1346] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:37.898187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388e65-220f-45a8-9e09-22e7ae5f1d08 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:37.898736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388e65-220f-45a8-9e09-22e7ae5f1d08 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:37.898736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a388e65-220f-45a8-9e09-22e7ae5f1d08 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:37.900166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 677/1347] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:37.905648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26b1b-3a89-498f-a32a-f2c0e29d197d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:37.906131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26b1b-3a89-498f-a32a-f2c0e29d197d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:37.906224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26b1b-3a89-498f-a32a-f2c0e29d197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:37.974243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-64b26b1b-3a89-498f-a32a-f2c0e29d197d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:37.975505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-64b26b1b-3a89-498f-a32a-f2c0e29d197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:38.076939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:38.079773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 671/1348] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:38.118037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a388e65-220f-45a8-9e09-22e7ae5f1d08 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:38.119778 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9a388e65-220f-45a8-9e09-22e7ae5f1d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:38.225246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a388e65-220f-45a8-9e09-22e7ae5f1d08 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:38.274520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:38.303174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41b3d4-26b6-4fbd-b40a-b99d0c119102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:38.303836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b3d4-26b6-4fbd-b40a-b99d0c119102 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:38.304122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b3d4-26b6-4fbd-b40a-b99d0c119102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:38.304400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b3d4-26b6-4fbd-b40a-b99d0c119102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:38.306064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ad41b3d4-26b6-4fbd-b40a-b99d0c119102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:38.415331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41b3d4-26b6-4fbd-b40a-b99d0c119102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:38.416783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41b3d4-26b6-4fbd-b40a-b99d0c119102 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:38.434831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 678/1349] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:43.256313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61716-a75f-44ac-ac5b-12d95df19222 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:43.256818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61716-a75f-44ac-ac5b-12d95df19222 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:43.257234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f61716-a75f-44ac-ac5b-12d95df19222 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:43.259037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 672/1350] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:43.286878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f527a-1a39-416a-8b22-a7926117cad0 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:43.286878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f527a-1a39-416a-8b22-a7926117cad0 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:43.286878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f527a-1a39-416a-8b22-a7926117cad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:43.411289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-c34f527a-1a39-416a-8b22-a7926117cad0 None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:43.412655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c34f527a-1a39-416a-8b22-a7926117cad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:43.433233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:43.532747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 679/1351] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:25:47.532916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771262-18f3-4433-b606-806c0cecccca None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:47.533473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771262-18f3-4433-b606-806c0cecccca None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:47.533556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771262-18f3-4433-b606-806c0cecccca None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:47.535685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 673/1352] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:47.540607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d729a-cc3b-49d8-8c08-4e793161b1ce None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:47.541031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d729a-cc3b-49d8-8c08-4e793161b1ce None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:47.541223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d729a-cc3b-49d8-8c08-4e793161b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:47.617291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-453d729a-cc3b-49d8-8c08-4e793161b1ce None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:47.618408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-453d729a-cc3b-49d8-8c08-4e793161b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:47.693738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:47.732322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 680/1353] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:49.203205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e5fe-107e-4160-88e9-96726633be13 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:49.203709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e5fe-107e-4160-88e9-96726633be13 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:49.203819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e5fe-107e-4160-88e9-96726633be13 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:49.205336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 674/1354] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:49.210532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f66e3-2e34-4203-bc38-3387c490ee44 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:49.210953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f66e3-2e34-4203-bc38-3387c490ee44 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:49.211216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f66e3-2e34-4203-bc38-3387c490ee44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:49.286383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f91f66e3-2e34-4203-bc38-3387c490ee44 None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:49.287646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f91f66e3-2e34-4203-bc38-3387c490ee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:49.393580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 681/1355] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:25:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:52.822871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c752-0cc2-4e89-9f79-bad25f073c99 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:52.823894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c752-0cc2-4e89-9f79-bad25f073c99 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:52.824469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c752-0cc2-4e89-9f79-bad25f073c99 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:52.826351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 675/1356] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:52.831815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d949d2-760b-4fee-b7b0-42d36a5a6da1 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:52.831815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d949d2-760b-4fee-b7b0-42d36a5a6da1 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:52.832375 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d949d2-760b-4fee-b7b0-42d36a5a6da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:52.879203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:52.913139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e9d949d2-760b-4fee-b7b0-42d36a5a6da1 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:52.914719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e9d949d2-760b-4fee-b7b0-42d36a5a6da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:53.017680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 682/1357] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:53.074847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87df9f-eab4-4667-8bde-b626072e52c1 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:53.075244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87df9f-eab4-4667-8bde-b626072e52c1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:53.075605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87df9f-eab4-4667-8bde-b626072e52c1 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:53.077062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 676/1358] 10.222.0.72 () {54 vars in 961 bytes} [Tue Jul 12 14:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:53.085471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e8b4-5785-452f-97ea-ab6beb4fb9de None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:53.085779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e8b4-5785-452f-97ea-ab6beb4fb9de None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:53.086241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e8b4-5785-452f-97ea-ab6beb4fb9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:53.178289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-60d7e8b4-5785-452f-97ea-ab6beb4fb9de None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:53.179646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-60d7e8b4-5785-452f-97ea-ab6beb4fb9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:53.231658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:53.316841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 683/1359] 10.222.0.72 () {58 vars in 1058 bytes} [Tue Jul 12 14:25:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:53.324913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87df9f-eab4-4667-8bde-b626072e52c1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:53.326478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0e87df9f-eab4-4667-8bde-b626072e52c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:53.473825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87df9f-eab4-4667-8bde-b626072e52c1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:53.549389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:53.593583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953df23-183f-4423-8801-d5cc64db8501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:53.594163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953df23-183f-4423-8801-d5cc64db8501 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:53.594450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953df23-183f-4423-8801-d5cc64db8501 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:53.594730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953df23-183f-4423-8801-d5cc64db8501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:53.596626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c953df23-183f-4423-8801-d5cc64db8501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:53.687710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953df23-183f-4423-8801-d5cc64db8501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:53.689309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953df23-183f-4423-8801-d5cc64db8501 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:53.708698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 677/1360] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:55.938696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89012ae5-d61a-4954-823e-15556e21a507 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:55.939252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89012ae5-d61a-4954-823e-15556e21a507 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:55.939363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89012ae5-d61a-4954-823e-15556e21a507 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:55.940880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 684/1361] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:55.945833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9c92-5939-44f5-b1fc-91e261b4decb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:55.946230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9c92-5939-44f5-b1fc-91e261b4decb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:55.946414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9c92-5939-44f5-b1fc-91e261b4decb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:56.015031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f2bd9c92-5939-44f5-b1fc-91e261b4decb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:56.016268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f2bd9c92-5939-44f5-b1fc-91e261b4decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:56.056919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:56.121650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 678/1362] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:56.165316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89012ae5-d61a-4954-823e-15556e21a507 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:56.166874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-89012ae5-d61a-4954-823e-15556e21a507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:56.320142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89012ae5-d61a-4954-823e-15556e21a507 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:56.329855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:56.439052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810894a-f29d-4217-8ce3-57e9aadb0e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:56.439733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810894a-f29d-4217-8ce3-57e9aadb0e21 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:56.440052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810894a-f29d-4217-8ce3-57e9aadb0e21 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:56.440052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810894a-f29d-4217-8ce3-57e9aadb0e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:56.442082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d810894a-f29d-4217-8ce3-57e9aadb0e21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:56.540668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810894a-f29d-4217-8ce3-57e9aadb0e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:56.542288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810894a-f29d-4217-8ce3-57e9aadb0e21 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:56.562170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 685/1363] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:58.908482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797190d-cbda-420a-9f27-74e947161585 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:58.909449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797190d-cbda-420a-9f27-74e947161585 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:58.909938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797190d-cbda-420a-9f27-74e947161585 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:58.911564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 679/1364] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:58.916939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ba95f-8524-42fe-af58-f8d85213fe55 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:58.917347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ba95f-8524-42fe-af58-f8d85213fe55 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:58.917509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ba95f-8524-42fe-af58-f8d85213fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:58.938927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:59.002523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f15ba95f-8524-42fe-af58-f8d85213fe55 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:59.003732 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f15ba95f-8524-42fe-af58-f8d85213fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:59.119162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 686/1365] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:59.163543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405d458-3ce3-42b3-ad9f-a84dd325d571 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:59.163836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405d458-3ce3-42b3-ad9f-a84dd325d571 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:59.164390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405d458-3ce3-42b3-ad9f-a84dd325d571 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:59.165863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 680/1366] 10.222.0.72 () {54 vars in 961 bytes} [Tue Jul 12 14:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:25:59.172367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bac14-c105-4c29-acc1-73d55da8ae85 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:59.172671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bac14-c105-4c29-acc1-73d55da8ae85 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:59.172956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bac14-c105-4c29-acc1-73d55da8ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:59.255195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-2d1bac14-c105-4c29-acc1-73d55da8ae85 None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:59.256416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2d1bac14-c105-4c29-acc1-73d55da8ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:59.292861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:59.380876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 687/1367] 10.222.0.72 () {58 vars in 1058 bytes} [Tue Jul 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:25:59.388963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405d458-3ce3-42b3-ad9f-a84dd325d571 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:59.390821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c405d458-3ce3-42b3-ad9f-a84dd325d571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:59.548693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405d458-3ce3-42b3-ad9f-a84dd325d571 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:59.570335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:59.674039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff11483-14b8-4611-ab6e-622896f8b914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:59.674715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11483-14b8-4611-ab6e-622896f8b914 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:59.675037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11483-14b8-4611-ab6e-622896f8b914 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:59.675324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11483-14b8-4611-ab6e-622896f8b914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:59.677041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1ff11483-14b8-4611-ab6e-622896f8b914 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:59.773525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff11483-14b8-4611-ab6e-622896f8b914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:59.775279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff11483-14b8-4611-ab6e-622896f8b914 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:59.795554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 681/1368] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:00.860211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f47ae9-c714-4fa8-acf5-4fc202fd654a None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:00.860720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f47ae9-c714-4fa8-acf5-4fc202fd654a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:00.860820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f47ae9-c714-4fa8-acf5-4fc202fd654a None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:00.862525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 688/1369] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:00.867879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f264-d345-43f9-9cb8-05a651275911 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:00.868333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f264-d345-43f9-9cb8-05a651275911 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:00.869023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f264-d345-43f9-9cb8-05a651275911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:00.901452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:00.943349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c876f264-d345-43f9-9cb8-05a651275911 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:00.944558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c876f264-d345-43f9-9cb8-05a651275911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:01.052616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 682/1370] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:01.408884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad4071-05b6-4898-9f89-9d113aa4f4d8 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:01.408884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad4071-05b6-4898-9f89-9d113aa4f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:01.408884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad4071-05b6-4898-9f89-9d113aa4f4d8 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:01.412108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 689/1371] 10.222.0.72 () {54 vars in 963 bytes} [Tue Jul 12 14:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:01.414679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57b89-8ec8-4bca-8a49-455621844401 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:01.415066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57b89-8ec8-4bca-8a49-455621844401 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:01.415415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57b89-8ec8-4bca-8a49-455621844401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:01.499024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a1e57b89-8ec8-4bca-8a49-455621844401 None None] MFA Rules not processed for user `b5188e1b57154bcba6fa56978085741d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:01.500563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a1e57b89-8ec8-4bca-8a49-455621844401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:01.555169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:01.587801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 683/1372] 10.222.0.72 () {58 vars in 1060 bytes} [Tue Jul 12 14:26:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:01.595342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad4071-05b6-4898-9f89-9d113aa4f4d8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:01.596934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a5ad4071-05b6-4898-9f89-9d113aa4f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:01.706012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad4071-05b6-4898-9f89-9d113aa4f4d8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:01.752207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:01.788637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:01.789296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:01.789582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:01.789861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:01.791547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:01.900887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce9832-47f7-4494-882f-7ab0d18a0536 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:01.901489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce9832-47f7-4494-882f-7ab0d18a0536 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:01.901489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce9832-47f7-4494-882f-7ab0d18a0536 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:01.906639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 684/1373] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:01.907881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d43c7-9106-4eb7-8443-f1a250a74d1e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:01.908441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d43c7-9106-4eb7-8443-f1a250a74d1e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:01.908729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d43c7-9106-4eb7-8443-f1a250a74d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:01.909942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:01.911450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:01.934066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 690/1374] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:01.990666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1e1d43c7-9106-4eb7-8443-f1a250a74d1e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:01.992241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1e1d43c7-9106-4eb7-8443-f1a250a74d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:02.106831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 685/1375] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:02.149917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:02.151414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:02.231028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:02.266733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b5d1-311f-4c9e-bc3a-d78232c60747 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:02.380331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33188e90-bd89-477f-b745-ef67673b6303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:02.380967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188e90-bd89-477f-b745-ef67673b6303 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:02.381252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188e90-bd89-477f-b745-ef67673b6303 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:02.381532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188e90-bd89-477f-b745-ef67673b6303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:02.383206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-33188e90-bd89-477f-b745-ef67673b6303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:02.460530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:02.471411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33188e90-bd89-477f-b745-ef67673b6303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:02.473009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33188e90-bd89-477f-b745-ef67673b6303 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:02.491258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 691/1376] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:04.536238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4ac2-207a-4bd2-a1b1-835b3c0cab50 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:04.536757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4ac2-207a-4bd2-a1b1-835b3c0cab50 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:04.536850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4ac2-207a-4bd2-a1b1-835b3c0cab50 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:04.538177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 686/1377] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:04.543964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf9961-1c73-47c4-b309-29afb9becbab None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:04.544427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf9961-1c73-47c4-b309-29afb9becbab None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:04.544533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf9961-1c73-47c4-b309-29afb9becbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:04.608095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-11cf9961-1c73-47c4-b309-29afb9becbab None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:04.609211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-11cf9961-1c73-47c4-b309-29afb9becbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:04.705044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 692/1378] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:04.748962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db4ac2-207a-4bd2-a1b1-835b3c0cab50 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:04.750511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d8db4ac2-207a-4bd2-a1b1-835b3c0cab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:04.807519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:04.915290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db4ac2-207a-4bd2-a1b1-835b3c0cab50 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:05.044594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be520c-ef21-4831-8e5c-c65c483e5ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:05.045185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be520c-ef21-4831-8e5c-c65c483e5ed6 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:05.045474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be520c-ef21-4831-8e5c-c65c483e5ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:05.045754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be520c-ef21-4831-8e5c-c65c483e5ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:05.047456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b6be520c-ef21-4831-8e5c-c65c483e5ed6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:05.059301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:05.140235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be520c-ef21-4831-8e5c-c65c483e5ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:05.141853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be520c-ef21-4831-8e5c-c65c483e5ed6 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:05.160947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 687/1379] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:07.221605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0455d4-72ba-4b0c-93e4-cdd30d05ee8e None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:07.222164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0455d4-72ba-4b0c-93e4-cdd30d05ee8e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:07.222164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0455d4-72ba-4b0c-93e4-cdd30d05ee8e None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:07.223719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 693/1380] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:07.228724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968786-9541-4013-ab3f-24a07de0e753 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:07.229154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968786-9541-4013-ab3f-24a07de0e753 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:07.229306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968786-9541-4013-ab3f-24a07de0e753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:07.300147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-85968786-9541-4013-ab3f-24a07de0e753 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:07.301373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-85968786-9541-4013-ab3f-24a07de0e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:07.395723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:07.410829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 688/1381] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:07.454021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0455d4-72ba-4b0c-93e4-cdd30d05ee8e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:07.455799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0b0455d4-72ba-4b0c-93e4-cdd30d05ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:07.532235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:07.625734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0455d4-72ba-4b0c-93e4-cdd30d05ee8e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:07.751657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d91b0-52d3-4faf-b989-2a70b544dd44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:07.752430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d91b0-52d3-4faf-b989-2a70b544dd44 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:07.752824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d91b0-52d3-4faf-b989-2a70b544dd44 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:07.753235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d91b0-52d3-4faf-b989-2a70b544dd44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:07.755002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f37d91b0-52d3-4faf-b989-2a70b544dd44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:07.779208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:07.852610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d91b0-52d3-4faf-b989-2a70b544dd44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:07.854481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d91b0-52d3-4faf-b989-2a70b544dd44 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:07.876639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 694/1382] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:09.923063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b157-ce22-46f2-95f2-28fb49572e62 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:09.923749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b157-ce22-46f2-95f2-28fb49572e62 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:09.923749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b157-ce22-46f2-95f2-28fb49572e62 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:09.924995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 689/1383] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:09.930847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3456d-d8ad-48bd-a322-d13bc1bc9a66 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:09.931296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3456d-d8ad-48bd-a322-d13bc1bc9a66 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:09.931462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3456d-d8ad-48bd-a322-d13bc1bc9a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:10.000670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e3e3456d-d8ad-48bd-a322-d13bc1bc9a66 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:10.001950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e3e3456d-d8ad-48bd-a322-d13bc1bc9a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:10.105876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:10.110363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 695/1384] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:26:10.155123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b157-ce22-46f2-95f2-28fb49572e62 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:10.157151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b3c4b157-ce22-46f2-95f2-28fb49572e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:10.309700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b157-ce22-46f2-95f2-28fb49572e62 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:10.378012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:10.430328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be26aa0-2b5b-4be1-b2c7-2238c70bd1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:10.430959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26aa0-2b5b-4be1-b2c7-2238c70bd1b4 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:10.431246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26aa0-2b5b-4be1-b2c7-2238c70bd1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:10.431534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26aa0-2b5b-4be1-b2c7-2238c70bd1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:10.433224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2be26aa0-2b5b-4be1-b2c7-2238c70bd1b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:10.528073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be26aa0-2b5b-4be1-b2c7-2238c70bd1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:10.530205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be26aa0-2b5b-4be1-b2c7-2238c70bd1b4 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:10.548974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 690/1385] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:12.651282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d145-2730-40eb-9bde-e3c97104e120 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:12.651884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d145-2730-40eb-9bde-e3c97104e120 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:12.651884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d145-2730-40eb-9bde-e3c97104e120 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:12.653162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 696/1386] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:12.659656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e4df-899c-41b6-aa13-d2fa78232571 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:12.660137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e4df-899c-41b6-aa13-d2fa78232571 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:12.660300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e4df-899c-41b6-aa13-d2fa78232571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:12.736470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9f02e4df-899c-41b6-aa13-d2fa78232571 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:12.738085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9f02e4df-899c-41b6-aa13-d2fa78232571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:12.765771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:12.851094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 691/1387] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:12.897957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996d145-2730-40eb-9bde-e3c97104e120 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:12.899689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7996d145-2730-40eb-9bde-e3c97104e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:13.051771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996d145-2730-40eb-9bde-e3c97104e120 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:13.142921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:13.195413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1a496-63b5-426a-87bd-b82385cddbca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:13.196278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1a496-63b5-426a-87bd-b82385cddbca service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:13.196472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1a496-63b5-426a-87bd-b82385cddbca service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:13.196622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1a496-63b5-426a-87bd-b82385cddbca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:13.198278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-92b1a496-63b5-426a-87bd-b82385cddbca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:13.288433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1a496-63b5-426a-87bd-b82385cddbca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:13.290054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1a496-63b5-426a-87bd-b82385cddbca service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:13.308674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 697/1388] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:26:15.366878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ae78-921f-44c2-9ce0-4fad7f6d2d7b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:15.367390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ae78-921f-44c2-9ce0-4fad7f6d2d7b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:15.367390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065ae78-921f-44c2-9ce0-4fad7f6d2d7b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:15.368736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 692/1389] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:26:15.374067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ece714-8de9-4269-a78f-f2a06b93115b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:15.374482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ece714-8de9-4269-a78f-f2a06b93115b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:15.374633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ece714-8de9-4269-a78f-f2a06b93115b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:15.438414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b0ece714-8de9-4269-a78f-f2a06b93115b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:15.439650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b0ece714-8de9-4269-a78f-f2a06b93115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:15.474529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:15.536691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 698/1390] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:15.580867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065ae78-921f-44c2-9ce0-4fad7f6d2d7b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:15.582420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6065ae78-921f-44c2-9ce0-4fad7f6d2d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:15.727445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065ae78-921f-44c2-9ce0-4fad7f6d2d7b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:15.736646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:15.838705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ba19-1613-4454-a706-aacd31a2a8c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:15.839388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ba19-1613-4454-a706-aacd31a2a8c7 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:15.839674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ba19-1613-4454-a706-aacd31a2a8c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:15.839955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ba19-1613-4454-a706-aacd31a2a8c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:15.841636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d258ba19-1613-4454-a706-aacd31a2a8c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:15.930236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ba19-1613-4454-a706-aacd31a2a8c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:15.931872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ba19-1613-4454-a706-aacd31a2a8c7 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:15.950610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 693/1391] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:16.995189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9da2-449a-48d8-87e3-3586c9bfe40e None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:16.995777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9da2-449a-48d8-87e3-3586c9bfe40e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:16.995777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9da2-449a-48d8-87e3-3586c9bfe40e None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:16.997761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 699/1392] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:17.002936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47e4e-cd99-42b1-a2e7-362ad306df58 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:17.003362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47e4e-cd99-42b1-a2e7-362ad306df58 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:17.003629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47e4e-cd99-42b1-a2e7-362ad306df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:17.018419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:17.073815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e9a47e4e-cd99-42b1-a2e7-362ad306df58 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:17.075108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e9a47e4e-cd99-42b1-a2e7-362ad306df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:17.191389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 694/1393] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:17.248208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7947e19-05cf-42df-a3d3-1035fc2f707c None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:17.248502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7947e19-05cf-42df-a3d3-1035fc2f707c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:17.248785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7947e19-05cf-42df-a3d3-1035fc2f707c None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:17.250161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 700/1394] 10.222.0.72 () {54 vars in 962 bytes} [Tue Jul 12 14:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:17.255151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa472c6-bf05-48c3-a8a3-2612d6fc45d7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:17.255456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa472c6-bf05-48c3-a8a3-2612d6fc45d7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:17.255739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa472c6-bf05-48c3-a8a3-2612d6fc45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:17.330368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2fa472c6-bf05-48c3-a8a3-2612d6fc45d7 None None] MFA Rules not processed for user `a81dce4c3ffd42bd85bf6e7687b5cbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:17.331505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2fa472c6-bf05-48c3-a8a3-2612d6fc45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:17.365796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:17.409034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 695/1395] 10.222.0.72 () {58 vars in 1059 bytes} [Tue Jul 12 14:26:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:26:17.416906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7947e19-05cf-42df-a3d3-1035fc2f707c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:17.418443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d7947e19-05cf-42df-a3d3-1035fc2f707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:17.521045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7947e19-05cf-42df-a3d3-1035fc2f707c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:17.584762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:17.597511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cc962-48ff-4641-82d9-d40741eea763 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a81dce4c3ffd42bd85bf6e7687b5cbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:17.598171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cc962-48ff-4641-82d9-d40741eea763 service glance] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:17.598460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cc962-48ff-4641-82d9-d40741eea763 service glance] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:17.598741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cc962-48ff-4641-82d9-d40741eea763 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:17.600429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ef0cc962-48ff-4641-82d9-d40741eea763 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:17.711266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cc962-48ff-4641-82d9-d40741eea763 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:17.712723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cc962-48ff-4641-82d9-d40741eea763 service glance] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:17.730915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 701/1396] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:18.008601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b127-8206-40c2-b0fe-9e7e768eeb58 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:18.009161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b127-8206-40c2-b0fe-9e7e768eeb58 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:18.009161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b127-8206-40c2-b0fe-9e7e768eeb58 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:18.010611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 696/1397] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:18.016836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f654c-93b9-4721-b0cf-b495fefea213 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:18.017316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f654c-93b9-4721-b0cf-b495fefea213 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:18.017418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f654c-93b9-4721-b0cf-b495fefea213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:18.089915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-697f654c-93b9-4721-b0cf-b495fefea213 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:18.091344 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-697f654c-93b9-4721-b0cf-b495fefea213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:18.135399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:18.192227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 702/1398] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:18.236390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b127-8206-40c2-b0fe-9e7e768eeb58 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:18.237926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e8e3b127-8206-40c2-b0fe-9e7e768eeb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:18.392203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b127-8206-40c2-b0fe-9e7e768eeb58 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:18.434343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:18.439115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3106b9-65fa-4098-8907-f41012bd6670 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:18.439414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3106b9-65fa-4098-8907-f41012bd6670 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:18.439697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3106b9-65fa-4098-8907-f41012bd6670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:18.504190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ab3106b9-65fa-4098-8907-f41012bd6670 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:18.505412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ab3106b9-65fa-4098-8907-f41012bd6670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:18.513360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36bc1b-adee-45d0-b1c5-e04511f2e2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:18.514408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36bc1b-adee-45d0-b1c5-e04511f2e2d8 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:18.514699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36bc1b-adee-45d0-b1c5-e04511f2e2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:18.515009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36bc1b-adee-45d0-b1c5-e04511f2e2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:18.516661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9d36bc1b-adee-45d0-b1c5-e04511f2e2d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:18.592768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 703/1399] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:26:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:26:18.609265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36bc1b-adee-45d0-b1c5-e04511f2e2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:18.611078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36bc1b-adee-45d0-b1c5-e04511f2e2d8 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:18.630284 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 697/1400] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:18.634416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043004d-e3a1-45de-8405-8235c4d086f9 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:18.634720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043004d-e3a1-45de-8405-8235c4d086f9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:18.635067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043004d-e3a1-45de-8405-8235c4d086f9 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:18.636657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 704/1401] 10.222.0.72 () {54 vars in 942 bytes} [Tue Jul 12 14:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:18.642645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f3c0-6d84-4cf4-9391-6a96fa07298c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:18.642922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f3c0-6d84-4cf4-9391-6a96fa07298c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:18.643210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459f3c0-6d84-4cf4-9391-6a96fa07298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:18.700661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:18.727047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d459f3c0-6d84-4cf4-9391-6a96fa07298c None None] MFA Rules not processed for user `9422f3bea364469093eb4046b011017e`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:18.728304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d459f3c0-6d84-4cf4-9391-6a96fa07298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:18.848656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 698/1402] 10.222.0.72 () {58 vars in 1039 bytes} [Tue Jul 12 14:26:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:18.858488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043004d-e3a1-45de-8405-8235c4d086f9 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:18.860111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c043004d-e3a1-45de-8405-8235c4d086f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:18.900910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:18.998228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043004d-e3a1-45de-8405-8235c4d086f9 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:19.112280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405d0cf-3ff5-4e27-93e2-ccd2ca57535c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:19.112945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d0cf-3ff5-4e27-93e2-ccd2ca57535c service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:19.113219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d0cf-3ff5-4e27-93e2-ccd2ca57535c service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:19.113501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d0cf-3ff5-4e27-93e2-ccd2ca57535c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:19.115363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3405d0cf-3ff5-4e27-93e2-ccd2ca57535c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:19.136372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:19.198356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405d0cf-3ff5-4e27-93e2-ccd2ca57535c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:19.199917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405d0cf-3ff5-4e27-93e2-ccd2ca57535c service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:19.208423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 705/1403] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:26:20.704045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0662500-5303-47e8-9ee3-8fbec02b297d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:20.704642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0662500-5303-47e8-9ee3-8fbec02b297d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:20.704642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0662500-5303-47e8-9ee3-8fbec02b297d None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:20.705989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 699/1404] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:20.711389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205e518-e69e-4fad-9c3b-2c496051e02f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:20.711802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205e518-e69e-4fad-9c3b-2c496051e02f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:20.711969 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205e518-e69e-4fad-9c3b-2c496051e02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:20.785356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-9205e518-e69e-4fad-9c3b-2c496051e02f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:20.786658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9205e518-e69e-4fad-9c3b-2c496051e02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:20.913854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 706/1405] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:20.959420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0662500-5303-47e8-9ee3-8fbec02b297d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:20.961545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e0662500-5303-47e8-9ee3-8fbec02b297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:21.083844 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:21.142198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0662500-5303-47e8-9ee3-8fbec02b297d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:21.272773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff59cb-36ad-4872-a728-292136addba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:21.273472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff59cb-36ad-4872-a728-292136addba5 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:21.273759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff59cb-36ad-4872-a728-292136addba5 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:21.274039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff59cb-36ad-4872-a728-292136addba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:21.275726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-afff59cb-36ad-4872-a728-292136addba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:21.349212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:21.372028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff59cb-36ad-4872-a728-292136addba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:21.373626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff59cb-36ad-4872-a728-292136addba5 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:21.392575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 700/1406] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:23.473101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12255-cc38-4e75-a477-08f7a4b99a79 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:23.473674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12255-cc38-4e75-a477-08f7a4b99a79 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:23.473674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12255-cc38-4e75-a477-08f7a4b99a79 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:23.475236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 707/1407] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:23.480509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716adf-4dde-4ab6-9de0-e7fd5e33d6af None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:23.480928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716adf-4dde-4ab6-9de0-e7fd5e33d6af None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:23.481116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716adf-4dde-4ab6-9de0-e7fd5e33d6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:23.552038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ef716adf-4dde-4ab6-9de0-e7fd5e33d6af None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:23.553546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ef716adf-4dde-4ab6-9de0-e7fd5e33d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:23.659345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 701/1408] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:23.703608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb12255-cc38-4e75-a477-08f7a4b99a79 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:23.705136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7eb12255-cc38-4e75-a477-08f7a4b99a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:23.720655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:23.865530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb12255-cc38-4e75-a477-08f7a4b99a79 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:23.959816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:23.989065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd9c64-ac80-44d3-8639-5d2690ebed15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:23.989838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd9c64-ac80-44d3-8639-5d2690ebed15 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:23.990193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd9c64-ac80-44d3-8639-5d2690ebed15 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:23.990547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd9c64-ac80-44d3-8639-5d2690ebed15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:23.992239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6ffd9c64-ac80-44d3-8639-5d2690ebed15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:24.098231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd9c64-ac80-44d3-8639-5d2690ebed15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:24.100163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd9c64-ac80-44d3-8639-5d2690ebed15 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:24.119328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 708/1409] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:33.657130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=81 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:34.116999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=56 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:41.805514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bfc35-dd98-4444-87e5-0ed872958b6b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:41.806058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bfc35-dd98-4444-87e5-0ed872958b6b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:41.806186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bfc35-dd98-4444-87e5-0ed872958b6b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:41.807526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 702/1410] 10.222.0.72 () {54 vars in 918 bytes} [Tue Jul 12 14:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:41.813147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a440-3146-47db-bd1b-fbaade15a9f7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:41.813608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a440-3146-47db-bd1b-fbaade15a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:41.813706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a440-3146-47db-bd1b-fbaade15a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:41.887783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a988a440-3146-47db-bd1b-fbaade15a9f7 None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:41.889646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a988a440-3146-47db-bd1b-fbaade15a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:41.993005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 709/1411] 10.222.0.72 () {58 vars in 1015 bytes} [Tue Jul 12 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:42.007698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da7ed-57fd-49e9-af54-45769ddbe205 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:42.007994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da7ed-57fd-49e9-af54-45769ddbe205 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:42.008279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da7ed-57fd-49e9-af54-45769ddbe205 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:42.009633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 703/1412] 10.222.0.72 () {54 vars in 918 bytes} [Tue Jul 12 14:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:42.014688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9bc4b-e68a-4935-b943-77926b867799 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:42.015009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9bc4b-e68a-4935-b943-77926b867799 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:42.015294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9bc4b-e68a-4935-b943-77926b867799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:42.089895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:42.092635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a4b9bc4b-e68a-4935-b943-77926b867799 None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:42.094392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a4b9bc4b-e68a-4935-b943-77926b867799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:42.207162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 710/1413] 10.222.0.72 () {58 vars in 1015 bytes} [Tue Jul 12 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:44.674872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3e497-b76e-4ac3-a4a5-0fe49409dbad None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:44.675398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3e497-b76e-4ac3-a4a5-0fe49409dbad None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:44.675516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3e497-b76e-4ac3-a4a5-0fe49409dbad None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:44.676805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:44.681949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cfb90-f5b4-4470-b047-ad687571b4d1 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:44.682372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cfb90-f5b4-4470-b047-ad687571b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:44.682520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cfb90-f5b4-4470-b047-ad687571b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:44.745957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-c59cfb90-f5b4-4470-b047-ad687571b4d1 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:44.747244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c59cfb90-f5b4-4470-b047-ad687571b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:44.803962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:44.846024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:44.889525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3e497-b76e-4ac3-a4a5-0fe49409dbad None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:44.891259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cae3e497-b76e-4ac3-a4a5-0fe49409dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:45.033071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3e497-b76e-4ac3-a4a5-0fe49409dbad None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:45.104195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:45.144678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aa0d2-3411-482b-86b0-c9b6a95d122e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:45.145337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa0d2-3411-482b-86b0-c9b6a95d122e service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:45.145625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa0d2-3411-482b-86b0-c9b6a95d122e service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:45.145904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa0d2-3411-482b-86b0-c9b6a95d122e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:45.147574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3b9aa0d2-3411-482b-86b0-c9b6a95d122e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:45.235347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9aa0d2-3411-482b-86b0-c9b6a95d122e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:45.236971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9aa0d2-3411-482b-86b0-c9b6a95d122e service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:45.255521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 705/1416] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:46.134120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852c85e-546f-413c-bf3f-805b02ac1aeb None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:46.134671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852c85e-546f-413c-bf3f-805b02ac1aeb None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:46.134671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852c85e-546f-413c-bf3f-805b02ac1aeb None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:46.136119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:46.141693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e53c-77a8-4861-9cb4-3be1974e09e4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:46.142092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e53c-77a8-4861-9cb4-3be1974e09e4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:46.142288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e53c-77a8-4861-9cb4-3be1974e09e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:46.216094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ca66e53c-77a8-4861-9cb4-3be1974e09e4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:46.217912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ca66e53c-77a8-4861-9cb4-3be1974e09e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:46.243984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:46.314130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:46.463925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852c85e-546f-413c-bf3f-805b02ac1aeb None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:46.465460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d852c85e-546f-413c-bf3f-805b02ac1aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:46.607379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852c85e-546f-413c-bf3f-805b02ac1aeb None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:46.646486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:46.717703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a199d96-617b-4eaa-9fd9-c1db8b936a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:46.718359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199d96-617b-4eaa-9fd9-c1db8b936a53 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:46.718661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199d96-617b-4eaa-9fd9-c1db8b936a53 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:46.718968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199d96-617b-4eaa-9fd9-c1db8b936a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:46.720623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4a199d96-617b-4eaa-9fd9-c1db8b936a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:46.809091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a199d96-617b-4eaa-9fd9-c1db8b936a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:46.810741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a199d96-617b-4eaa-9fd9-c1db8b936a53 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:46.828881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 713/1419] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:47.711235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03047-19db-43b0-a906-d49114b6d09c None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:47.711773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03047-19db-43b0-a906-d49114b6d09c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:47.711870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03047-19db-43b0-a906-d49114b6d09c None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:47.713215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:47.718364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e878842-826c-448d-a2ff-06a65de2e2d2 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:47.718803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e878842-826c-448d-a2ff-06a65de2e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:47.718967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e878842-826c-448d-a2ff-06a65de2e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:47.771825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:47.794111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1e878842-826c-448d-a2ff-06a65de2e2d2 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:47.795938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1e878842-826c-448d-a2ff-06a65de2e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:47.892504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:48.046046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d03047-19db-43b0-a906-d49114b6d09c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:48.048093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-26d03047-19db-43b0-a906-d49114b6d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:48.195544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d03047-19db-43b0-a906-d49114b6d09c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:48.208175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:48.308400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ecb68-f140-4883-b4b7-66be55637aa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:48.308979 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ecb68-f140-4883-b4b7-66be55637aa9 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:48.309265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ecb68-f140-4883-b4b7-66be55637aa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:48.309549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ecb68-f140-4883-b4b7-66be55637aa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:48.311248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b81ecb68-f140-4883-b4b7-66be55637aa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:48.399287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ecb68-f140-4883-b4b7-66be55637aa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:48.400893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ecb68-f140-4883-b4b7-66be55637aa9 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:48.419429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 708/1422] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:49.268106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cecef-47b0-4d4b-be9b-6d5e9d2b6cf8 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:49.268641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cecef-47b0-4d4b-be9b-6d5e9d2b6cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:49.268759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cecef-47b0-4d4b-be9b-6d5e9d2b6cf8 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:49.270056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:26:49.274928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a833d-a1a5-4df6-aaaf-bc06de5b8f4b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:49.275327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a833d-a1a5-4df6-aaaf-bc06de5b8f4b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:49.275502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a833d-a1a5-4df6-aaaf-bc06de5b8f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:49.296559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:49.352499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-002a833d-a1a5-4df6-aaaf-bc06de5b8f4b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:49.353647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-002a833d-a1a5-4df6-aaaf-bc06de5b8f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:49.449416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:49.598225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cecef-47b0-4d4b-be9b-6d5e9d2b6cf8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:49.599832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ec6cecef-47b0-4d4b-be9b-6d5e9d2b6cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:49.710190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:49.746101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cecef-47b0-4d4b-be9b-6d5e9d2b6cf8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:49.856682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be329f-beed-4408-84b5-25df46824eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:49.857337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be329f-beed-4408-84b5-25df46824eac service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:49.857628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be329f-beed-4408-84b5-25df46824eac service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:49.858559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be329f-beed-4408-84b5-25df46824eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:49.860122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f9be329f-beed-4408-84b5-25df46824eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:49.937516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:49.951817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be329f-beed-4408-84b5-25df46824eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:49.953422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be329f-beed-4408-84b5-25df46824eac service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:49.971166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 716/1425] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:50.836684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1e29-3eee-4e0d-948b-3097dc7401a1 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:50.837196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1e29-3eee-4e0d-948b-3097dc7401a1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:50.837307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1e29-3eee-4e0d-948b-3097dc7401a1 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:50.838625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:50.843501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea33ea-f215-47a3-8a39-54e14e88c40d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:50.843904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea33ea-f215-47a3-8a39-54e14e88c40d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:50.844079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea33ea-f215-47a3-8a39-54e14e88c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:50.917883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-66ea33ea-f215-47a3-8a39-54e14e88c40d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:50.919154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-66ea33ea-f215-47a3-8a39-54e14e88c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:51.016255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:51.165671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1e29-3eee-4e0d-948b-3097dc7401a1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:51.167240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9c3e1e29-3eee-4e0d-948b-3097dc7401a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:51.367137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:51.428040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1e29-3eee-4e0d-948b-3097dc7401a1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:51.542175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc96c-ab86-4a03-a361-23f0562081cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:51.542849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc96c-ab86-4a03-a361-23f0562081cc service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:51.543135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc96c-ab86-4a03-a361-23f0562081cc service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:51.543411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc96c-ab86-4a03-a361-23f0562081cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:51.545295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f23dc96c-ab86-4a03-a361-23f0562081cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:51.591424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:51.632528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc96c-ab86-4a03-a361-23f0562081cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:51.634042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc96c-ab86-4a03-a361-23f0562081cc service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:51.651708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 711/1428] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:52.455248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8913-b28a-48bb-82e6-b3872729dd34 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:52.455805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8913-b28a-48bb-82e6-b3872729dd34 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:52.455805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8913-b28a-48bb-82e6-b3872729dd34 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:52.457201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:52.462352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d8763-04e2-401e-ad32-7563d51b81e9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:52.462795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d8763-04e2-401e-ad32-7563d51b81e9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:52.462957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d8763-04e2-401e-ad32-7563d51b81e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:52.535748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e85d8763-04e2-401e-ad32-7563d51b81e9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:52.537238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e85d8763-04e2-401e-ad32-7563d51b81e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:52.631108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:52.779367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8913-b28a-48bb-82e6-b3872729dd34 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:52.780844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-998b8913-b28a-48bb-82e6-b3872729dd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:52.829566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:52.924624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8913-b28a-48bb-82e6-b3872729dd34 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:53.036604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad785631-954f-4e66-8c2a-38eaac0bb649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:53.037455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785631-954f-4e66-8c2a-38eaac0bb649 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:53.037776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785631-954f-4e66-8c2a-38eaac0bb649 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:53.038067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785631-954f-4e66-8c2a-38eaac0bb649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:53.039770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ad785631-954f-4e66-8c2a-38eaac0bb649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:53.047370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:53.130035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad785631-954f-4e66-8c2a-38eaac0bb649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:53.131680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad785631-954f-4e66-8c2a-38eaac0bb649 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:53.149428 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 719/1431] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:53.941722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495f3f0-fea6-4594-964e-9d7585b2ec81 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:53.942290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495f3f0-fea6-4594-964e-9d7585b2ec81 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:53.942290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495f3f0-fea6-4594-964e-9d7585b2ec81 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:53.943710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:53.948548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a62d25-6634-497c-8f22-36e2f988f2de None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:53.948961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a62d25-6634-497c-8f22-36e2f988f2de None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:53.949143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a62d25-6634-497c-8f22-36e2f988f2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:54.021817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-49a62d25-6634-497c-8f22-36e2f988f2de None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:54.023050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-49a62d25-6634-497c-8f22-36e2f988f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:54.088679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:54.117699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:54.268122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495f3f0-fea6-4594-964e-9d7585b2ec81 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:54.269538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4495f3f0-fea6-4594-964e-9d7585b2ec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:54.286603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:54.411670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495f3f0-fea6-4594-964e-9d7585b2ec81 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:54.496520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:54.522347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01d1f9-d637-4c51-b18d-44fbf445af9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:54.522969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01d1f9-d637-4c51-b18d-44fbf445af9c service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:54.523259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01d1f9-d637-4c51-b18d-44fbf445af9c service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:54.523540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01d1f9-d637-4c51-b18d-44fbf445af9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:54.525178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2d01d1f9-d637-4c51-b18d-44fbf445af9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:54.617487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01d1f9-d637-4c51-b18d-44fbf445af9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:54.619098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01d1f9-d637-4c51-b18d-44fbf445af9c service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:54.636696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 714/1434] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:55.426582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebb24c-38f3-4558-801f-9777a6b1a86d None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:55.427174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebb24c-38f3-4558-801f-9777a6b1a86d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:55.427174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebb24c-38f3-4558-801f-9777a6b1a86d None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:55.428564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:55.433335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ae96e-de21-40a8-82a0-873bf41d5cb8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:55.433775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ae96e-de21-40a8-82a0-873bf41d5cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:55.433966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ae96e-de21-40a8-82a0-873bf41d5cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:55.507215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c87ae96e-de21-40a8-82a0-873bf41d5cb8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:55.508414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c87ae96e-de21-40a8-82a0-873bf41d5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:55.548651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:55.603616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:55.753415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebb24c-38f3-4558-801f-9777a6b1a86d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:55.755009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d7ebb24c-38f3-4558-801f-9777a6b1a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:55.898735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebb24c-38f3-4558-801f-9777a6b1a86d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:55.951103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:56.009145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503fe7e-0d80-4b8a-9026-b73e1fa66eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:56.009729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503fe7e-0d80-4b8a-9026-b73e1fa66eba service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:56.010011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503fe7e-0d80-4b8a-9026-b73e1fa66eba service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:56.010305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503fe7e-0d80-4b8a-9026-b73e1fa66eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:56.011954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b503fe7e-0d80-4b8a-9026-b73e1fa66eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:56.100004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503fe7e-0d80-4b8a-9026-b73e1fa66eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:56.101639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503fe7e-0d80-4b8a-9026-b73e1fa66eba service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:56.119983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 722/1437] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:56.920664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf1564-6255-4cba-a590-03b7a8c2655b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:56.921194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf1564-6255-4cba-a590-03b7a8c2655b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:56.921312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf1564-6255-4cba-a590-03b7a8c2655b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:56.922609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:56.927530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a26e40-5d5c-4da0-b476-fc562875a339 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:56.927962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a26e40-5d5c-4da0-b476-fc562875a339 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:56.928101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a26e40-5d5c-4da0-b476-fc562875a339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:57.006007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-40a26e40-5d5c-4da0-b476-fc562875a339 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:57.007275 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-40a26e40-5d5c-4da0-b476-fc562875a339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:57.009265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:57.102397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:57.252229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf1564-6255-4cba-a590-03b7a8c2655b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:57.253762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-62bf1564-6255-4cba-a590-03b7a8c2655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:57.397516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf1564-6255-4cba-a590-03b7a8c2655b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:57.424568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:57.508112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dc11b-5fc2-4858-bac2-7a5608cf3544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:57.508757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc11b-5fc2-4858-bac2-7a5608cf3544 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:57.509042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc11b-5fc2-4858-bac2-7a5608cf3544 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:57.509343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc11b-5fc2-4858-bac2-7a5608cf3544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:57.511007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5b0dc11b-5fc2-4858-bac2-7a5608cf3544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:57.597915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dc11b-5fc2-4858-bac2-7a5608cf3544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:26:57.599471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dc11b-5fc2-4858-bac2-7a5608cf3544 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:26:57.617714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 717/1440] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:59.540351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15dd2-b046-4189-a208-b14b7c6c21af None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:59.540942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15dd2-b046-4189-a208-b14b7c6c21af None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:59.540942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15dd2-b046-4189-a208-b14b7c6c21af None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:59.542324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:26:59.547965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e038ed-91e4-45e5-8bca-3660256b210b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:59.548400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e038ed-91e4-45e5-8bca-3660256b210b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:59.548508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e038ed-91e4-45e5-8bca-3660256b210b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:59.587573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:59.616152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-43e038ed-91e4-45e5-8bca-3660256b210b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:26:59.617360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-43e038ed-91e4-45e5-8bca-3660256b210b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:59.711012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:26:59.749811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac15dd2-b046-4189-a208-b14b7c6c21af None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:26:59.751377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7ac15dd2-b046-4189-a208-b14b7c6c21af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:26:59.852787 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac15dd2-b046-4189-a208-b14b7c6c21af None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:26:59.884225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:59.927094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345b091-e1ad-448f-8e2f-9746792d25c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:26:59.927758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b091-e1ad-448f-8e2f-9746792d25c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:26:59.928048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b091-e1ad-448f-8e2f-9746792d25c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:26:59.928327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345b091-e1ad-448f-8e2f-9746792d25c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:26:59.930002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d345b091-e1ad-448f-8e2f-9746792d25c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:00.036976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345b091-e1ad-448f-8e2f-9746792d25c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:00.038718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345b091-e1ad-448f-8e2f-9746792d25c7 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:00.060780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 725/1443] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:02.223988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fdbf-7200-48c2-bd38-e0b7cfebb99a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:02.224541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fdbf-7200-48c2-bd38-e0b7cfebb99a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:02.224541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fdbf-7200-48c2-bd38-e0b7cfebb99a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:02.225958 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:02.231400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6586c5-e960-400e-b04e-5766a8813fb4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:02.231807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6586c5-e960-400e-b04e-5766a8813fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:02.231961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6586c5-e960-400e-b04e-5766a8813fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:02.296690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ea6586c5-e960-400e-b04e-5766a8813fb4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:02.297929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ea6586c5-e960-400e-b04e-5766a8813fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:02.310463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:02.392814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:02.430536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0fdbf-7200-48c2-bd38-e0b7cfebb99a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:02.432085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d0c0fdbf-7200-48c2-bd38-e0b7cfebb99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:02.534261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0fdbf-7200-48c2-bd38-e0b7cfebb99a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:02.546703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:02.606649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5be79d-09c3-4d94-9bdf-58b293c03077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:02.607329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5be79d-09c3-4d94-9bdf-58b293c03077 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:02.607616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5be79d-09c3-4d94-9bdf-58b293c03077 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:02.607896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5be79d-09c3-4d94-9bdf-58b293c03077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:02.609532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bc5be79d-09c3-4d94-9bdf-58b293c03077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:02.717635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5be79d-09c3-4d94-9bdf-58b293c03077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:02.719667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5be79d-09c3-4d94-9bdf-58b293c03077 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:02.737477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 720/1446] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:05.057914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec702-6232-480f-8ce6-fae0c49dc932 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:05.058447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec702-6232-480f-8ce6-fae0c49dc932 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:05.058447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec702-6232-480f-8ce6-fae0c49dc932 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:05.059885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:05.065319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b7743-0b0f-4d18-805d-e8575b39ed3b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:05.065715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b7743-0b0f-4d18-805d-e8575b39ed3b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:05.065871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b7743-0b0f-4d18-805d-e8575b39ed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:05.111605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:05.129278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-109b7743-0b0f-4d18-805d-e8575b39ed3b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:05.130497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-109b7743-0b0f-4d18-805d-e8575b39ed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:05.225278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:05.263458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ec702-6232-480f-8ce6-fae0c49dc932 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:05.264991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a62ec702-6232-480f-8ce6-fae0c49dc932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:05.367770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ec702-6232-480f-8ce6-fae0c49dc932 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:05.407220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:05.440250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a86887-8555-473b-a025-41213db39c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:05.440895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a86887-8555-473b-a025-41213db39c74 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:05.441179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a86887-8555-473b-a025-41213db39c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:05.441456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a86887-8555-473b-a025-41213db39c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:05.443119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b3a86887-8555-473b-a025-41213db39c74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:05.551088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a86887-8555-473b-a025-41213db39c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:05.552558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a86887-8555-473b-a025-41213db39c74 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:05.685212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 728/1449] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:07.817079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40a7f-5dca-4e62-9dda-88bdcdc5de0f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:07.817619 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40a7f-5dca-4e62-9dda-88bdcdc5de0f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:07.817750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40a7f-5dca-4e62-9dda-88bdcdc5de0f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:07.819058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:07.824616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6540-2990-4025-a078-3a0b3f596cec None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:07.825049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6540-2990-4025-a078-3a0b3f596cec None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:07.825188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a6540-2990-4025-a078-3a0b3f596cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:07.889740 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-2d3a6540-2990-4025-a078-3a0b3f596cec None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:07.891039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2d3a6540-2990-4025-a078-3a0b3f596cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:07.911531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:07.986978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:08.025696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb40a7f-5dca-4e62-9dda-88bdcdc5de0f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:08.027305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3fb40a7f-5dca-4e62-9dda-88bdcdc5de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:08.132865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb40a7f-5dca-4e62-9dda-88bdcdc5de0f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:08.151899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:08.207899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d06cc-bf1e-49a8-94a5-456f0ee2521e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:08.208560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d06cc-bf1e-49a8-94a5-456f0ee2521e service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:08.208850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d06cc-bf1e-49a8-94a5-456f0ee2521e service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:08.209261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d06cc-bf1e-49a8-94a5-456f0ee2521e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:08.210964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b91d06cc-bf1e-49a8-94a5-456f0ee2521e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:08.319148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d06cc-bf1e-49a8-94a5-456f0ee2521e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:08.320590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d06cc-bf1e-49a8-94a5-456f0ee2521e service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:08.339006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 723/1452] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:10.477416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a914-0d63-4560-8126-c562d82073a9 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:10.477954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a914-0d63-4560-8126-c562d82073a9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:10.477954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92a914-0d63-4560-8126-c562d82073a9 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:10.479365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:10.484982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cda35-bd88-46d6-85e2-9a33c5b367ab None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:10.485389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cda35-bd88-46d6-85e2-9a33c5b367ab None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:10.485545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cda35-bd88-46d6-85e2-9a33c5b367ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:10.546129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:10.549281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9c0cda35-bd88-46d6-85e2-9a33c5b367ab None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:10.550853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9c0cda35-bd88-46d6-85e2-9a33c5b367ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:10.645578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:10.683291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a914-0d63-4560-8126-c562d82073a9 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:10.684832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6e92a914-0d63-4560-8126-c562d82073a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:10.785281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92a914-0d63-4560-8126-c562d82073a9 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:10.833745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:10.857429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45f954-6526-4cac-9350-30dcaf3d6bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:10.858085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45f954-6526-4cac-9350-30dcaf3d6bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:10.858372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45f954-6526-4cac-9350-30dcaf3d6bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:10.858653 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45f954-6526-4cac-9350-30dcaf3d6bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:10.860809 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ce45f954-6526-4cac-9350-30dcaf3d6bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:10.966146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45f954-6526-4cac-9350-30dcaf3d6bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:10.967602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45f954-6526-4cac-9350-30dcaf3d6bc3 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:10.985412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 731/1455] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:13.164903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31a90-07d8-4936-a034-915660b81ae1 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:13.165466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31a90-07d8-4936-a034-915660b81ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:13.165466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31a90-07d8-4936-a034-915660b81ae1 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:13.166858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:13.172035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260ebf-1c0c-48ab-981b-0dd7c601f393 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:13.172408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260ebf-1c0c-48ab-981b-0dd7c601f393 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:13.172615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260ebf-1c0c-48ab-981b-0dd7c601f393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:13.235535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-51260ebf-1c0c-48ab-981b-0dd7c601f393 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:13.236745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-51260ebf-1c0c-48ab-981b-0dd7c601f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:13.265261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:13.333213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:13.370399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31a90-07d8-4936-a034-915660b81ae1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:13.372034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c7e31a90-07d8-4936-a034-915660b81ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:13.475133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31a90-07d8-4936-a034-915660b81ae1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:13.502702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:13.547526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ab5bb-e72b-43f1-b802-c1b64946965b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:13.548199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ab5bb-e72b-43f1-b802-c1b64946965b service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:13.548471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ab5bb-e72b-43f1-b802-c1b64946965b service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:13.548748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ab5bb-e72b-43f1-b802-c1b64946965b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:13.550388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9a3ab5bb-e72b-43f1-b802-c1b64946965b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:13.658432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ab5bb-e72b-43f1-b802-c1b64946965b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:13.659893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ab5bb-e72b-43f1-b802-c1b64946965b service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:13.678600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 726/1458] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:15.752693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd495-5939-4849-8636-28329707176a None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:15.753304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd495-5939-4849-8636-28329707176a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:15.753304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd495-5939-4849-8636-28329707176a None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:15.754644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:15.759903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69efd-4bef-45eb-b3db-272589e26774 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:15.760318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69efd-4bef-45eb-b3db-272589e26774 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:15.760467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69efd-4bef-45eb-b3db-272589e26774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:15.823629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0bc69efd-4bef-45eb-b3db-272589e26774 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:15.824828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0bc69efd-4bef-45eb-b3db-272589e26774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:15.833211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:15.922263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:15.959405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bd495-5939-4849-8636-28329707176a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:15.960982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-af6bd495-5939-4849-8636-28329707176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:16.062862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bd495-5939-4849-8636-28329707176a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:16.116726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:16.136177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460397f0-6a08-442d-a4c2-cff0630625db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:16.136829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460397f0-6a08-442d-a4c2-cff0630625db service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:16.137119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460397f0-6a08-442d-a4c2-cff0630625db service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:16.137391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460397f0-6a08-442d-a4c2-cff0630625db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:16.139065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-460397f0-6a08-442d-a4c2-cff0630625db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:16.245438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460397f0-6a08-442d-a4c2-cff0630625db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:16.246894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460397f0-6a08-442d-a4c2-cff0630625db service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:16.265082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 734/1461] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:18.426420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1db40-dd9e-4ff3-8b19-fc86bf67a055 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:18.426964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1db40-dd9e-4ff3-8b19-fc86bf67a055 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:18.427073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1db40-dd9e-4ff3-8b19-fc86bf67a055 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:18.428368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:18.433520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36c847-a08e-47c8-b481-3efe840526fe None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:18.433925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36c847-a08e-47c8-b481-3efe840526fe None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:18.434097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36c847-a08e-47c8-b481-3efe840526fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:18.497832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-dc36c847-a08e-47c8-b481-3efe840526fe None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:18.499081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-dc36c847-a08e-47c8-b481-3efe840526fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:18.537532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:18.599896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:18.636771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1db40-dd9e-4ff3-8b19-fc86bf67a055 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:18.638310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-05d1db40-dd9e-4ff3-8b19-fc86bf67a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:18.740997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1db40-dd9e-4ff3-8b19-fc86bf67a055 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:18.777582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:18.813557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd72597-0c64-464b-be58-a8ed8b8a4376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:18.814228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72597-0c64-464b-be58-a8ed8b8a4376 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:18.814515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72597-0c64-464b-be58-a8ed8b8a4376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:18.814815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd72597-0c64-464b-be58-a8ed8b8a4376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:18.816446 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5dd72597-0c64-464b-be58-a8ed8b8a4376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:18.922096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd72597-0c64-464b-be58-a8ed8b8a4376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:18.923663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd72597-0c64-464b-be58-a8ed8b8a4376 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:18.941208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 729/1464] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:20.976051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c27d7-ea2c-43c0-a3ee-bfe93ea15ee4 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:20.976611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c27d7-ea2c-43c0-a3ee-bfe93ea15ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:20.976611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c27d7-ea2c-43c0-a3ee-bfe93ea15ee4 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:20.978011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:20.983152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3037077-772a-4501-9922-8e39ab8d96ea None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:20.983541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3037077-772a-4501-9922-8e39ab8d96ea None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:20.983731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3037077-772a-4501-9922-8e39ab8d96ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:21.047696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a3037077-772a-4501-9922-8e39ab8d96ea None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:21.048918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a3037077-772a-4501-9922-8e39ab8d96ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:21.067124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:21.146931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:21.183127 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c27d7-ea2c-43c0-a3ee-bfe93ea15ee4 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:21.184672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9c8c27d7-ea2c-43c0-a3ee-bfe93ea15ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:21.286230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c27d7-ea2c-43c0-a3ee-bfe93ea15ee4 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:21.351097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:21.358241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970255-612d-41ad-a12a-b8bd11569542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:21.358992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970255-612d-41ad-a12a-b8bd11569542 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:21.359765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970255-612d-41ad-a12a-b8bd11569542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:21.360073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970255-612d-41ad-a12a-b8bd11569542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:21.361737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-72970255-612d-41ad-a12a-b8bd11569542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:21.466228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72970255-612d-41ad-a12a-b8bd11569542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:21.467688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72970255-612d-41ad-a12a-b8bd11569542 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:21.485964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 737/1467] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:23.558275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1f04-72c6-4033-95a3-0ea6a030e2b1 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:23.558839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1f04-72c6-4033-95a3-0ea6a030e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:23.558971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1f04-72c6-4033-95a3-0ea6a030e2b1 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:23.560382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:23.565604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83715b17-f117-49f1-879f-dd11f9317c68 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:23.566029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83715b17-f117-49f1-879f-dd11f9317c68 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:23.566162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83715b17-f117-49f1-879f-dd11f9317c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:23.629537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-83715b17-f117-49f1-879f-dd11f9317c68 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:23.630722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-83715b17-f117-49f1-879f-dd11f9317c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:23.677656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:23.726115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:23.761916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1f04-72c6-4033-95a3-0ea6a030e2b1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:23.763551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-82da1f04-72c6-4033-95a3-0ea6a030e2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:23.864148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1f04-72c6-4033-95a3-0ea6a030e2b1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:23.911747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:23.938231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f97fa2-def0-4661-9163-e9fd7c6305d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:23.938933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97fa2-def0-4661-9163-e9fd7c6305d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:23.939212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97fa2-def0-4661-9163-e9fd7c6305d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:23.939492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97fa2-def0-4661-9163-e9fd7c6305d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:23.941141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e7f97fa2-def0-4661-9163-e9fd7c6305d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:24.048249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f97fa2-def0-4661-9163-e9fd7c6305d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:24.049682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f97fa2-def0-4661-9163-e9fd7c6305d5 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:24.067875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 732/1470] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:33.724268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=22 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:34.065548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=66 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:43.577883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27720d-1e71-44eb-bec1-e09cf207ceb4 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:43.578395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27720d-1e71-44eb-bec1-e09cf207ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:43.578395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27720d-1e71-44eb-bec1-e09cf207ceb4 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:43.580387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 739/1471] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:43.585533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b7760-0d28-4f10-b30a-24556d8c7236 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:43.585960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b7760-0d28-4f10-b30a-24556d8c7236 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:43.586138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b7760-0d28-4f10-b30a-24556d8c7236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:43.649480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-785b7760-0d28-4f10-b30a-24556d8c7236 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:43.650691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-785b7760-0d28-4f10-b30a-24556d8c7236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:43.745672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 733/1472] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:43.828444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482677b7-5454-491d-b1e5-e81ea6beb8ce None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:43.828680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482677b7-5454-491d-b1e5-e81ea6beb8ce None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:43.828963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482677b7-5454-491d-b1e5-e81ea6beb8ce None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:43.830317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 740/1473] 10.222.0.72 () {54 vars in 962 bytes} [Tue Jul 12 14:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:43.835129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e5024-aa88-4544-873f-1224f30ffb95 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:43.835423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e5024-aa88-4544-873f-1224f30ffb95 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:43.835734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e5024-aa88-4544-873f-1224f30ffb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:43.909460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-219e5024-aa88-4544-873f-1224f30ffb95 None None] MFA Rules not processed for user `a81dce4c3ffd42bd85bf6e7687b5cbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:43.910672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-219e5024-aa88-4544-873f-1224f30ffb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:43.931442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:43.986043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 734/1474] 10.222.0.72 () {58 vars in 1059 bytes} [Tue Jul 12 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:43.993308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482677b7-5454-491d-b1e5-e81ea6beb8ce None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:43.994856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-482677b7-5454-491d-b1e5-e81ea6beb8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:44.096439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482677b7-5454-491d-b1e5-e81ea6beb8ce None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:44.167568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736461-702f-40a5-bf2a-65ae053bf0e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a81dce4c3ffd42bd85bf6e7687b5cbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:44.168222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736461-702f-40a5-bf2a-65ae053bf0e7 service glance] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:44.168510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736461-702f-40a5-bf2a-65ae053bf0e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:44.168790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736461-702f-40a5-bf2a-65ae053bf0e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:44.170434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-69736461-702f-40a5-bf2a-65ae053bf0e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:44.223331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:44.276900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736461-702f-40a5-bf2a-65ae053bf0e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:44.278337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736461-702f-40a5-bf2a-65ae053bf0e7 service glance] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:44.296949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 741/1475] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:46.376910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80d51c-09e8-4364-b15f-90e84d711f3c None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:46.377444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80d51c-09e8-4364-b15f-90e84d711f3c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:46.377444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80d51c-09e8-4364-b15f-90e84d711f3c None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:46.378762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 735/1476] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:46.384083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404fc0-ff20-4216-a202-2c02762b0bd5 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:46.384489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404fc0-ff20-4216-a202-2c02762b0bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:46.384654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a404fc0-ff20-4216-a202-2c02762b0bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:46.447997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1a404fc0-ff20-4216-a202-2c02762b0bd5 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:46.449196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1a404fc0-ff20-4216-a202-2c02762b0bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:46.543521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 742/1477] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:46.567778 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80d51c-09e8-4364-b15f-90e84d711f3c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:46.569293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3e80d51c-09e8-4364-b15f-90e84d711f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:46.696480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80d51c-09e8-4364-b15f-90e84d711f3c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:46.744217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:46.788509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa26939-50da-4377-acca-ec1c79f1e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:46.789187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26939-50da-4377-acca-ec1c79f1e38a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:46.789476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26939-50da-4377-acca-ec1c79f1e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:46.789758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26939-50da-4377-acca-ec1c79f1e38a admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:46.790522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa26939-50da-4377-acca-ec1c79f1e38a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:46.792563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING py.warnings [None req-3fa26939-50da-4377-acca-ec1c79f1e38a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:27:46.792563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: warnings.warn(msg) Jul 12 14:27:46.792563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: Jul 12 14:27:46.793697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa26939-50da-4377-acca-ec1c79f1e38a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:46.812886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 736/1478] 10.222.0.72 () {56 vars in 1108 bytes} [Tue Jul 12 14:27:46 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:27:48.872622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf4de5-3b2b-485b-b6c0-72276e0653f5 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:48.873119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf4de5-3b2b-485b-b6c0-72276e0653f5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:48.873215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf4de5-3b2b-485b-b6c0-72276e0653f5 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:48.874570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 743/1479] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:48.879838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0f63-46f8-4258-80f4-11e985399d85 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:48.880221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0f63-46f8-4258-80f4-11e985399d85 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:48.880444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0f63-46f8-4258-80f4-11e985399d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:48.943667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-67ce0f63-46f8-4258-80f4-11e985399d85 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:48.944870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-67ce0f63-46f8-4258-80f4-11e985399d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:49.039088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 737/1480] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:49.082609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf4de5-3b2b-485b-b6c0-72276e0653f5 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:49.084229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-efcf4de5-3b2b-485b-b6c0-72276e0653f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:49.095037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:49.234655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf4de5-3b2b-485b-b6c0-72276e0653f5 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:49.315669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:49.349035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca4ec-23a3-4641-8f6d-8f7eaada38ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:49.349634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca4ec-23a3-4641-8f6d-8f7eaada38ea service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:49.349923 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca4ec-23a3-4641-8f6d-8f7eaada38ea service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:49.350202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca4ec-23a3-4641-8f6d-8f7eaada38ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:49.351927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-952ca4ec-23a3-4641-8f6d-8f7eaada38ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:49.438335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca4ec-23a3-4641-8f6d-8f7eaada38ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:49.440485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca4ec-23a3-4641-8f6d-8f7eaada38ea service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:49.458620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 744/1481] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:51.698607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd703-8267-4ce2-9162-c2ee3185ef1b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:51.699228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd703-8267-4ce2-9162-c2ee3185ef1b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:51.699228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd703-8267-4ce2-9162-c2ee3185ef1b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:51.700597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 738/1482] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:51.706424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3e24-c3a4-4c89-bdbb-884252d5304a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:51.706857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3e24-c3a4-4c89-bdbb-884252d5304a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:51.707020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3e24-c3a4-4c89-bdbb-884252d5304a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:51.770810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5a3b3e24-c3a4-4c89-bdbb-884252d5304a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:51.772602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5a3b3e24-c3a4-4c89-bdbb-884252d5304a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:51.820768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:51.872477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 745/1483] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:51.909067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd703-8267-4ce2-9162-c2ee3185ef1b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:51.910603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b21dd703-8267-4ce2-9162-c2ee3185ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:51.934448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:52.012793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd703-8267-4ce2-9162-c2ee3185ef1b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:52.086028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde2a20-f7bc-40ec-a7ca-0c579d526532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:52.086687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2a20-f7bc-40ec-a7ca-0c579d526532 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:52.086998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2a20-f7bc-40ec-a7ca-0c579d526532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:52.087275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2a20-f7bc-40ec-a7ca-0c579d526532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:52.088915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4cde2a20-f7bc-40ec-a7ca-0c579d526532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:52.161115 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:52.196571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2a20-f7bc-40ec-a7ca-0c579d526532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:52.198007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2a20-f7bc-40ec-a7ca-0c579d526532 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:52.215917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 739/1484] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:54.292336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b944fe4-18d1-4c6c-b6f7-de7f6fff8fe1 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:54.292908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b944fe4-18d1-4c6c-b6f7-de7f6fff8fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:54.292908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b944fe4-18d1-4c6c-b6f7-de7f6fff8fe1 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:54.294284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 746/1485] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:54.300051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3a9e-4842-4152-a1c4-e5a61fb2a6c4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:54.300494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3a9e-4842-4152-a1c4-e5a61fb2a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:54.300648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3a9e-4842-4152-a1c4-e5a61fb2a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:54.363242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fcdc3a9e-4842-4152-a1c4-e5a61fb2a6c4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:54.364439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fcdc3a9e-4842-4152-a1c4-e5a61fb2a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:54.458571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 740/1486] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:54.495939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b944fe4-18d1-4c6c-b6f7-de7f6fff8fe1 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:54.497485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7b944fe4-18d1-4c6c-b6f7-de7f6fff8fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:54.599469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b944fe4-18d1-4c6c-b6f7-de7f6fff8fe1 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:54.669511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:54.670429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90c96c-fa06-4749-a409-83ef35d7cd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:54.671115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90c96c-fa06-4749-a409-83ef35d7cd92 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:54.671594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90c96c-fa06-4749-a409-83ef35d7cd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:54.672113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90c96c-fa06-4749-a409-83ef35d7cd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:54.674512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5f90c96c-fa06-4749-a409-83ef35d7cd92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:54.781565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90c96c-fa06-4749-a409-83ef35d7cd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:54.783560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90c96c-fa06-4749-a409-83ef35d7cd92 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:54.802466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 747/1487] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:56.887563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc853-1548-428c-92af-6eb9652bda8e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:56.888071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc853-1548-428c-92af-6eb9652bda8e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:56.888174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc853-1548-428c-92af-6eb9652bda8e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:56.889494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 741/1488] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:56.895241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0074-7276-49b9-8033-91bbe3083024 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:56.895701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0074-7276-49b9-8033-91bbe3083024 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:56.895807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0074-7276-49b9-8033-91bbe3083024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:56.958815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-fc6a0074-7276-49b9-8033-91bbe3083024 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:56.960033 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fc6a0074-7276-49b9-8033-91bbe3083024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:57.011011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:57.055052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 748/1489] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:57.095529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dc853-1548-428c-92af-6eb9652bda8e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:57.097061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8c3dc853-1548-428c-92af-6eb9652bda8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:57.132278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:57.208081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dc853-1548-428c-92af-6eb9652bda8e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:57.280797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79c6ba-2976-4d37-b450-7d0d5e06fb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:57.281466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79c6ba-2976-4d37-b450-7d0d5e06fb47 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:57.281732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79c6ba-2976-4d37-b450-7d0d5e06fb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:57.282011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79c6ba-2976-4d37-b450-7d0d5e06fb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:57.283705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-db79c6ba-2976-4d37-b450-7d0d5e06fb47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:57.363303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:27:57.392197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79c6ba-2976-4d37-b450-7d0d5e06fb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:27:57.393638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79c6ba-2976-4d37-b450-7d0d5e06fb47 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:27:57.411704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 742/1490] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:27:59.606974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0994-905a-4f30-8425-fb394caeb301 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:59.607520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0994-905a-4f30-8425-fb394caeb301 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:59.607520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0994-905a-4f30-8425-fb394caeb301 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:59.608948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 749/1491] 10.222.0.72 () {54 vars in 926 bytes} [Tue Jul 12 14:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:27:59.614103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ddef-e5e0-4b77-94e3-509868dcafec None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:59.614490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ddef-e5e0-4b77-94e3-509868dcafec None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:59.614672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ddef-e5e0-4b77-94e3-509868dcafec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:59.678680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e470ddef-e5e0-4b77-94e3-509868dcafec None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:27:59.679931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e470ddef-e5e0-4b77-94e3-509868dcafec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:59.775143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 743/1492] 10.222.0.72 () {58 vars in 1023 bytes} [Tue Jul 12 14:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:27:59.813756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f0994-905a-4f30-8425-fb394caeb301 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:27:59.815871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-196f0994-905a-4f30-8425-fb394caeb301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:27:59.919624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f0994-905a-4f30-8425-fb394caeb301 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:27:59.990426 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873d60e-fb61-42b7-81e3-d74a9f44b98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:27:59.991102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873d60e-fb61-42b7-81e3-d74a9f44b98b service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:27:59.991391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873d60e-fb61-42b7-81e3-d74a9f44b98b service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:27:59.991671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873d60e-fb61-42b7-81e3-d74a9f44b98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:27:59.993317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9873d60e-fb61-42b7-81e3-d74a9f44b98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:28:00.002848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:28:00.101107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873d60e-fb61-42b7-81e3-d74a9f44b98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:28:00.102555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873d60e-fb61-42b7-81e3-d74a9f44b98b service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:28:00.120054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 750/1493] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:28:09.773243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=82 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:28:10.117739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=50 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:25.723607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9e110-ab92-48a8-b44a-779395e5d90a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:25.724222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9e110-ab92-48a8-b44a-779395e5d90a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:25.724222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9e110-ab92-48a8-b44a-779395e5d90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:25.800908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-45c9e110-ab92-48a8-b44a-779395e5d90a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:29:25.802130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-45c9e110-ab92-48a8-b44a-779395e5d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:25.897807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 744/1494] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:29:25.905784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adeb7a-7174-4dfd-bdd8-8abda8db7661 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:25.906274 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adeb7a-7174-4dfd-bdd8-8abda8db7661 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:25.906377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adeb7a-7174-4dfd-bdd8-8abda8db7661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:25.979641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-32adeb7a-7174-4dfd-bdd8-8abda8db7661 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:29:25.980765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-32adeb7a-7174-4dfd-bdd8-8abda8db7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:26.073574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 751/1495] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:29:26.078189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9e110-ab92-48a8-b44a-779395e5d90a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:26.079445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-45c9e110-ab92-48a8-b44a-779395e5d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:26.091488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9e110-ab92-48a8-b44a-779395e5d90a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:26.151296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:26.185705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:26.186375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:26.186658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:26.186974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:26.187691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:29:26.187996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:26.189493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING py.warnings [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:29:26.189493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: warnings.warn(msg) Jul 12 14:29:26.189493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: Jul 12 14:29:26.190367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:26.201413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 745/1496] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:29:26.210219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adeb7a-7174-4dfd-bdd8-8abda8db7661 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:26.219490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adeb7a-7174-4dfd-bdd8-8abda8db7661 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:26.280064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:26.314628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:26.315325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:26.315603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:26.315876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:26.316552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:26.318277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING py.warnings [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:29:26.318277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: warnings.warn(msg) Jul 12 14:29:26.318277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: Jul 12 14:29:26.319489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:26.371565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 752/1497] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:29:26 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:29:26.375747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:26.377796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:26.410456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791f907-a1d1-4f79-ba8a-d1638c2bfc57 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:26.504300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:26.504982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:26.505269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:26.505548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:26.506249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:26.507288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING py.warnings [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:29:26.507288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: warnings.warn(msg) Jul 12 14:29:26.507288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: Jul 12 14:29:26.508492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:26.547927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 746/1498] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:29:26 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:29:26.552441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:26.553946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:26.615698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d82d8-4f5d-40d6-a855-c63ac21fce6e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:26.699042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:26.710913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:26.711589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:26.711875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:26.712152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:26.712878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:26.713958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING py.warnings [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:29:26.713958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: warnings.warn(msg) Jul 12 14:29:26.713958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: Jul 12 14:29:26.714897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:26.727255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 753/1499] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:29:26.731290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:26.732816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:26.744647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47587394-546d-4c82-bb65-1c0066512962 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:26.769629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:26.840277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a044a3-1e0f-46f9-925d-e3104380fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:26.840879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a044a3-1e0f-46f9-925d-e3104380fda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:26.841165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a044a3-1e0f-46f9-925d-e3104380fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:26.841444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a044a3-1e0f-46f9-925d-e3104380fda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:26.842168 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a044a3-1e0f-46f9-925d-e3104380fda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:26.843209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING py.warnings [None req-04a044a3-1e0f-46f9-925d-e3104380fda1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:29:26.843209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: warnings.warn(msg) Jul 12 14:29:26.843209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: Jul 12 14:29:26.844094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a044a3-1e0f-46f9-925d-e3104380fda1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:26.862063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 747/1500] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:29:26.866290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:26.867874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:26.901010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12136f1b-d502-4f6b-9df5-a6f794b510c6 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:26.993922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601253-3c66-4b58-b92e-689ed28db664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:26.994848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601253-3c66-4b58-b92e-689ed28db664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:26.995144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601253-3c66-4b58-b92e-689ed28db664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:26.995429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601253-3c66-4b58-b92e-689ed28db664 admin admin] PATH_INFO: `/v3/projects/5de8b7f7f0074e679c8c76a16985aed0/users/09cb292b9cfa4a8ca349258f8ceb9b31/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:27.017168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17601253-3c66-4b58-b92e-689ed28db664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de8b7f7f0074e679c8c76a16985aed0, user_id=09cb292b9cfa4a8ca349258f8ceb9b31, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:27.018220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING py.warnings [None req-17601253-3c66-4b58-b92e-689ed28db664 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:29:27.018220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: warnings.warn(msg) Jul 12 14:29:27.018220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: Jul 12 14:29:27.020259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17601253-3c66-4b58-b92e-689ed28db664 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:27.045315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 754/1501] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:29:26 2022] PUT /identity/v3/projects/5de8b7f7f0074e679c8c76a16985aed0/users/09cb292b9cfa4a8ca349258f8ceb9b31/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:29:27.057889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd513-b0db-42ef-a062-0538191a64fe None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:27.058265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd513-b0db-42ef-a062-0538191a64fe None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:27.058617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd513-b0db-42ef-a062-0538191a64fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:27.115162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3d5dd513-b0db-42ef-a062-0538191a64fe None None] MFA Rules not processed for user `09cb292b9cfa4a8ca349258f8ceb9b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:29:27.116315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3d5dd513-b0db-42ef-a062-0538191a64fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:27.192916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 748/1502] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:29:27.206417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b65e04-c9e4-4f2f-8ba1-a680d3d098fb None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:27.206710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b65e04-c9e4-4f2f-8ba1-a680d3d098fb None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:27.207024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b65e04-c9e4-4f2f-8ba1-a680d3d098fb None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:27.208391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 755/1503] 10.222.0.72 () {54 vars in 963 bytes} [Tue Jul 12 14:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:29:27.213173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05ae31-26e9-44c2-9878-69bb81acbcab None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:27.213475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05ae31-26e9-44c2-9878-69bb81acbcab None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:27.213775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05ae31-26e9-44c2-9878-69bb81acbcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:27.244588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:27.288765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5b05ae31-26e9-44c2-9878-69bb81acbcab None None] MFA Rules not processed for user `b5188e1b57154bcba6fa56978085741d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:29:27.289980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5b05ae31-26e9-44c2-9878-69bb81acbcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:27.364426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 749/1504] 10.222.0.72 () {58 vars in 1060 bytes} [Tue Jul 12 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:29:27.372030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b65e04-c9e4-4f2f-8ba1-a680d3d098fb None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:27.373518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-19b65e04-c9e4-4f2f-8ba1-a680d3d098fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:27.424728 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:27.479452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b65e04-c9e4-4f2f-8ba1-a680d3d098fb None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:27.551491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:27.552153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:27.552440 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:27.552717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:27.554364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:27.651062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:27.652516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:27.656024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:27.671788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 756/1505] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:29:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:29:27.713779 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d016e3-21b0-467d-8ded-0734a7f9c931 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:27.714082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d016e3-21b0-467d-8ded-0734a7f9c931 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:27.714401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d016e3-21b0-467d-8ded-0734a7f9c931 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:27.715732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 750/1506] 10.222.0.72 () {52 vars in 829 bytes} [Tue Jul 12 14:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:29:27.719290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:27.721078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:27.817731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0e1ef-7074-437c-8d74-cf1af1cd953c service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:27.909845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:27.910690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:27.911012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:27.911293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] PATH_INFO: `/v3/users/09cb292b9cfa4a8ca349258f8ceb9b31` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:27.923710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cb292b9cfa4a8ca349258f8ceb9b31)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:27.924761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING py.warnings [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:29:27.924761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: warnings.warn(msg) Jul 12 14:29:27.924761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: Jul 12 14:29:27.925965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:27.935422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:27.989642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cb292b9cfa4a8ca349258f8ceb9b31'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:28.007519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cb292b9cfa4a8ca349258f8ceb9b31'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:28.008079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cb292b9cfa4a8ca349258f8ceb9b31'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:28.017262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cb292b9cfa4a8ca349258f8ceb9b31'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:28.031097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cb292b9cfa4a8ca349258f8ceb9b31'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:28.037289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 757/1507] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:29:27 2022] DELETE /identity/v3/users/09cb292b9cfa4a8ca349258f8ceb9b31 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:29:28.041681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a930220-dddd-4315-9cb9-7afb8ab66d42 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:28.042129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a930220-dddd-4315-9cb9-7afb8ab66d42 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:28.042263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a930220-dddd-4315-9cb9-7afb8ab66d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:28.097528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3a930220-dddd-4315-9cb9-7afb8ab66d42 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:29:28.098724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3a930220-dddd-4315-9cb9-7afb8ab66d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:28.172349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:28.184994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 751/1508] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:29:28.194267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:28.195542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:28.293595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a034a8-c281-42d5-96f8-92a0704105cb admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:28.347718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:28.367940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d4c01-2aa5-4c98-b6b7-5389833e3cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:28.368597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4c01-2aa5-4c98-b6b7-5389833e3cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:28.368883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4c01-2aa5-4c98-b6b7-5389833e3cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:28.369162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4c01-2aa5-4c98-b6b7-5389833e3cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:28.370813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1e9d4c01-2aa5-4c98-b6b7-5389833e3cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:28.475744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d4c01-2aa5-4c98-b6b7-5389833e3cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:28.477103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d4c01-2aa5-4c98-b6b7-5389833e3cf3 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:28.494839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 758/1509] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:29:28.816871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a930220-dddd-4315-9cb9-7afb8ab66d42 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:29:28.818114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3a930220-dddd-4315-9cb9-7afb8ab66d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:29:28.829685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a930220-dddd-4315-9cb9-7afb8ab66d42 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:29:28.926225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:29:28.927139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:29:28.927427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:29:28.927703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] PATH_INFO: `/v3/projects/5de8b7f7f0074e679c8c76a16985aed0` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:29:28.937429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de8b7f7f0074e679c8c76a16985aed0)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:29:28.939120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING py.warnings [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:29:28.939120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: warnings.warn(msg) Jul 12 14:29:28.939120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: Jul 12 14:29:28.940327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:29:28.997374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de8b7f7f0074e679c8c76a16985aed0', 'request_id': 'req-39eb1e37-6003-4821-ae04-fa673e4f098a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:29.012097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de8b7f7f0074e679c8c76a16985aed0', 'request_id': 'req-39eb1e37-6003-4821-ae04-fa673e4f098a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:29.017963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de8b7f7f0074e679c8c76a16985aed0', 'request_id': 'req-39eb1e37-6003-4821-ae04-fa673e4f098a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:29.044569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] The token cache is being invalidate because project 5de8b7f7f0074e679c8c76a16985aed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:29:29.045235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:29.045343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39eb1e37-6003-4821-ae04-fa673e4f098a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:29:29.046723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 752/1510] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:29:28 2022] DELETE /identity/v3/projects/5de8b7f7f0074e679c8c76a16985aed0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:29:38.492569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=62 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:29:39.042287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:15.355051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2794496-7685-4ffa-9ab0-8ec3870115dc None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:15.355607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2794496-7685-4ffa-9ab0-8ec3870115dc None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:15.355607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2794496-7685-4ffa-9ab0-8ec3870115dc None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:15.356951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:31:15.361658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994c6f-06da-49f5-9f28-5564b1e3310d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:15.362119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994c6f-06da-49f5-9f28-5564b1e3310d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:15.362229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994c6f-06da-49f5-9f28-5564b1e3310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:15.440637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-8f994c6f-06da-49f5-9f28-5564b1e3310d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:15.441850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8f994c6f-06da-49f5-9f28-5564b1e3310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:15.542788 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:31:15.694971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2794496-7685-4ffa-9ab0-8ec3870115dc None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:15.697133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a2794496-7685-4ffa-9ab0-8ec3870115dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:15.818302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2794496-7685-4ffa-9ab0-8ec3870115dc None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:15.823812 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4af773-9bc7-4aa8-9915-5efee70d4d27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:15.824464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4af773-9bc7-4aa8-9915-5efee70d4d27 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:15.824777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4af773-9bc7-4aa8-9915-5efee70d4d27 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:15.825058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4af773-9bc7-4aa8-9915-5efee70d4d27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:15.832949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4af773-9bc7-4aa8-9915-5efee70d4d27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:15.835082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4af773-9bc7-4aa8-9915-5efee70d4d27 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:15.844318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 760/1513] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:31:16.656829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe018c6-c6b2-425b-b167-b47a62068f0d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:16.657375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe018c6-c6b2-425b-b167-b47a62068f0d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:16.657375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe018c6-c6b2-425b-b167-b47a62068f0d None None] PATH_INFO: `/v3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:16.658799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 754/1514] 10.222.0.44 () {54 vars in 925 bytes} [Tue Jul 12 14:31:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:31:16.659526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5db5d-a639-4921-93f2-bf30472e85c2 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:16.659930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5db5d-a639-4921-93f2-bf30472e85c2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:16.660164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5db5d-a639-4921-93f2-bf30472e85c2 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:16.662017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 761/1515] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:31:16.664965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8b5e-eae4-42d7-9762-c36829d005bd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:16.665263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8b5e-eae4-42d7-9762-c36829d005bd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:16.665549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8b5e-eae4-42d7-9762-c36829d005bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:16.667193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d23c3-d741-4bed-8d53-4dada31c7566 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:16.667488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d23c3-d741-4bed-8d53-4dada31c7566 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:16.667804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d23c3-d741-4bed-8d53-4dada31c7566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:16.686313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-973d23c3-d741-4bed-8d53-4dada31c7566 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:16.687557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-973d23c3-d741-4bed-8d53-4dada31c7566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:16.695998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 762/1516] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:31:16.724302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-26ba8b5e-eae4-42d7-9762-c36829d005bd None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:16.726093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-26ba8b5e-eae4-42d7-9762-c36829d005bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:16.755640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:16.797609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 755/1517] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jul 12 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:31:16.847948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d23c3-d741-4bed-8d53-4dada31c7566 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:16.860646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d23c3-d741-4bed-8d53-4dada31c7566 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:16.866765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2a050-907c-4915-9608-9851c074cabd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:16.867445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2a050-907c-4915-9608-9851c074cabd service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:16.867734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2a050-907c-4915-9608-9851c074cabd service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:16.868019 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2a050-907c-4915-9608-9851c074cabd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:16.876082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2a050-907c-4915-9608-9851c074cabd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:16.877670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2a050-907c-4915-9608-9851c074cabd service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:16.887004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 763/1518] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:31:25.859318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b1a2-a230-4a3f-989a-f64679c5c1b8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:25.859842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b1a2-a230-4a3f-989a-f64679c5c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:25.859842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b1a2-a230-4a3f-989a-f64679c5c1b8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:25.861207 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 756/1519] 10.222.0.72 () {54 vars in 960 bytes} [Tue Jul 12 14:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:31:25.866734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6317-588a-4b8e-8b46-d751ea27b175 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:25.867195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6317-588a-4b8e-8b46-d751ea27b175 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:25.867333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6317-588a-4b8e-8b46-d751ea27b175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:25.886013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d5ae6317-588a-4b8e-8b46-d751ea27b175 None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:25.887247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d5ae6317-588a-4b8e-8b46-d751ea27b175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:25.895799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 764/1520] 10.222.0.72 () {58 vars in 1057 bytes} [Tue Jul 12 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:31:25.903343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b1a2-a230-4a3f-989a-f64679c5c1b8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:25.917212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b1a2-a230-4a3f-989a-f64679c5c1b8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:25.922062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6f84-3cb3-439a-b467-a0595bd0f8a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:25.922720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6f84-3cb3-439a-b467-a0595bd0f8a7 service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:25.923063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6f84-3cb3-439a-b467-a0595bd0f8a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:25.923346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6f84-3cb3-439a-b467-a0595bd0f8a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:25.932172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6f84-3cb3-439a-b467-a0595bd0f8a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:25.933800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6f84-3cb3-439a-b467-a0595bd0f8a7 service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:25.943407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 757/1521] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:31:28.113088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55802-4383-4d8e-80ef-fd050ca79be6 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:28.113625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55802-4383-4d8e-80ef-fd050ca79be6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:28.113744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55802-4383-4d8e-80ef-fd050ca79be6 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:28.117325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:31:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:31:28.122087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ba08b-d905-4658-9e34-ebe0a55a0d18 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:28.122502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ba08b-d905-4658-9e34-ebe0a55a0d18 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:28.122661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ba08b-d905-4658-9e34-ebe0a55a0d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:28.140547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d62ba08b-d905-4658-9e34-ebe0a55a0d18 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:28.141743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d62ba08b-d905-4658-9e34-ebe0a55a0d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:28.149553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:31:28.304088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc55802-4383-4d8e-80ef-fd050ca79be6 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:28.318444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc55802-4383-4d8e-80ef-fd050ca79be6 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:28.323778 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11f979-51d5-46be-a5a9-d947141d042b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:28.324415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f979-51d5-46be-a5a9-d947141d042b service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:28.324703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f979-51d5-46be-a5a9-d947141d042b service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:28.324985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f979-51d5-46be-a5a9-d947141d042b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:28.332974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11f979-51d5-46be-a5a9-d947141d042b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:28.335115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11f979-51d5-46be-a5a9-d947141d042b service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:28.344438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 766/1524] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:31:29.160039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b702b-d1f7-484a-8e04-a95c472cb7ce None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:29.160746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b702b-d1f7-484a-8e04-a95c472cb7ce None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:29.160897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b702b-d1f7-484a-8e04-a95c472cb7ce None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:29.162315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:31:29.167014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fcbf-7145-478f-abdb-4ecb1a46cc4a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:29.167443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fcbf-7145-478f-abdb-4ecb1a46cc4a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:29.167598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fcbf-7145-478f-abdb-4ecb1a46cc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:29.185587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-8b77fcbf-7145-478f-abdb-4ecb1a46cc4a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:29.187211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8b77fcbf-7145-478f-abdb-4ecb1a46cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:29.195620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:31:29.344525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b702b-d1f7-484a-8e04-a95c472cb7ce None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:29.359292 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b702b-d1f7-484a-8e04-a95c472cb7ce None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:29.364637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0ccc-4ab8-48aa-afd8-a5af83f87ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:29.365919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0ccc-4ab8-48aa-afd8-a5af83f87ef8 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:29.366210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0ccc-4ab8-48aa-afd8-a5af83f87ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:29.366496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0ccc-4ab8-48aa-afd8-a5af83f87ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:29.374563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0ccc-4ab8-48aa-afd8-a5af83f87ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:29.376185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0ccc-4ab8-48aa-afd8-a5af83f87ef8 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:29.385501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 760/1527] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:31:33.242051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6bbf7-9c12-4e16-b4a9-4d53c26c189e None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:33.242563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6bbf7-9c12-4e16-b4a9-4d53c26c189e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:33.242563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6bbf7-9c12-4e16-b4a9-4d53c26c189e None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:33.243945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:31:33.249132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c633b-f77d-4842-ba1d-995af48246be None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:33.249559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c633b-f77d-4842-ba1d-995af48246be None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:33.249713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c633b-f77d-4842-ba1d-995af48246be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:33.269403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1c8c633b-f77d-4842-ba1d-995af48246be None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:33.270651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1c8c633b-f77d-4842-ba1d-995af48246be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:33.279024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:31:33.353130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6bbf7-9c12-4e16-b4a9-4d53c26c189e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:33.354851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f1e6bbf7-9c12-4e16-b4a9-4d53c26c189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:33.417327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:33.432324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6bbf7-9c12-4e16-b4a9-4d53c26c189e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:33.435803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb5130-6f77-4bfc-9621-b5c0a2d55309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:33.436453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5130-6f77-4bfc-9621-b5c0a2d55309 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:33.436735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5130-6f77-4bfc-9621-b5c0a2d55309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:33.437010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5130-6f77-4bfc-9621-b5c0a2d55309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:33.446132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb5130-6f77-4bfc-9621-b5c0a2d55309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:33.447582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb5130-6f77-4bfc-9621-b5c0a2d55309 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:33.457429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 769/1530] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:31:35.443863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a423-967b-41f4-8fa9-ded09bedd2c8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:35.444420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a423-967b-41f4-8fa9-ded09bedd2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:35.444420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a423-967b-41f4-8fa9-ded09bedd2c8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:35.445791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:31:35.450861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65348d-5dc8-4040-8167-0058a660317e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:35.451300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65348d-5dc8-4040-8167-0058a660317e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:35.451444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65348d-5dc8-4040-8167-0058a660317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:35.469482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-cb65348d-5dc8-4040-8167-0058a660317e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:35.470687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-cb65348d-5dc8-4040-8167-0058a660317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:35.479261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:31:35.514622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4a423-967b-41f4-8fa9-ded09bedd2c8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:35.516301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-42a4a423-967b-41f4-8fa9-ded09bedd2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:35.528959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4a423-967b-41f4-8fa9-ded09bedd2c8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:35.532489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c335d-4d7c-4634-850a-6976895ca08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:35.533127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c335d-4d7c-4634-850a-6976895ca08c service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:35.533411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c335d-4d7c-4634-850a-6976895ca08c service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:35.533686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c335d-4d7c-4634-850a-6976895ca08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:35.543270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c335d-4d7c-4634-850a-6976895ca08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:35.544688 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c335d-4d7c-4634-850a-6976895ca08c service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:35.554526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 763/1533] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:31:39.090276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c5d1-53c5-4f9b-9574-92c75bbdb465 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:39.090810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c5d1-53c5-4f9b-9574-92c75bbdb465 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:39.090908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c5d1-53c5-4f9b-9574-92c75bbdb465 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:39.092234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:31:39.097449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8a98-3406-4d21-9ca1-7c15942813ee None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:39.097908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8a98-3406-4d21-9ca1-7c15942813ee None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:39.098007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8a98-3406-4d21-9ca1-7c15942813ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:39.117027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e18a8a98-3406-4d21-9ca1-7c15942813ee None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:39.118273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e18a8a98-3406-4d21-9ca1-7c15942813ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:39.125996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:31:39.425455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c5d1-53c5-4f9b-9574-92c75bbdb465 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:39.427170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2f43c5d1-53c5-4f9b-9574-92c75bbdb465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:39.504195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c5d1-53c5-4f9b-9574-92c75bbdb465 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:39.508267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc8871-bf55-403c-ba21-3d8a2564f4f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:39.508911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8871-bf55-403c-ba21-3d8a2564f4f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:39.509197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8871-bf55-403c-ba21-3d8a2564f4f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:39.509481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8871-bf55-403c-ba21-3d8a2564f4f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:39.518237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc8871-bf55-403c-ba21-3d8a2564f4f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:39.519710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc8871-bf55-403c-ba21-3d8a2564f4f8 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:39.529218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 772/1536] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:31:41.555943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18444b3-9ecd-433c-8c6c-54a93f47ee00 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:41.556440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18444b3-9ecd-433c-8c6c-54a93f47ee00 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:41.556537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18444b3-9ecd-433c-8c6c-54a93f47ee00 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:41.557875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:31:41.562965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7167-d070-4f6d-8c01-5dd61b051db4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:41.563357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7167-d070-4f6d-8c01-5dd61b051db4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:41.563541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7167-d070-4f6d-8c01-5dd61b051db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:41.581289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-dbdd7167-d070-4f6d-8c01-5dd61b051db4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:31:41.582470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-dbdd7167-d070-4f6d-8c01-5dd61b051db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:41.590130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:31:41.891957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18444b3-9ecd-433c-8c6c-54a93f47ee00 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:31:41.893968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d18444b3-9ecd-433c-8c6c-54a93f47ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:31:41.907334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18444b3-9ecd-433c-8c6c-54a93f47ee00 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:31:41.911027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237786-1dca-4836-8930-b0fb5d03f86b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:31:41.912285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237786-1dca-4836-8930-b0fb5d03f86b service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:31:41.912568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237786-1dca-4836-8930-b0fb5d03f86b service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:31:41.912842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237786-1dca-4836-8930-b0fb5d03f86b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:31:41.921548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237786-1dca-4836-8930-b0fb5d03f86b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:31:41.922980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237786-1dca-4836-8930-b0fb5d03f86b service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:31:41.932155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 766/1539] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:31:51.576253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=50 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:31:51.928123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=50 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:14.396366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b2f9-357e-4669-9a66-8a7f565c3fdc None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.397543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b2f9-357e-4669-9a66-8a7f565c3fdc None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.398068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b2f9-357e-4669-9a66-8a7f565c3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.420973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a8c4b2f9-357e-4669-9a66-8a7f565c3fdc None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.422566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a8c4b2f9-357e-4669-9a66-8a7f565c3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.437721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 774/1540] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.447495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814ad8-bcc6-491b-bf33-b0f427c9e424 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.448587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814ad8-bcc6-491b-bf33-b0f427c9e424 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.449096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814ad8-bcc6-491b-bf33-b0f427c9e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.473783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-74814ad8-bcc6-491b-bf33-b0f427c9e424 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.475392 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-74814ad8-bcc6-491b-bf33-b0f427c9e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.478083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e40a-09cd-49e9-877e-6314167fefb4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.478376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e40a-09cd-49e9-877e-6314167fefb4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.478688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e40a-09cd-49e9-877e-6314167fefb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.486834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 767/1541] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.491475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814ad8-bcc6-491b-bf33-b0f427c9e424 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:14.500879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814ad8-bcc6-491b-bf33-b0f427c9e424 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:14.510300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5032e40a-09cd-49e9-877e-6314167fefb4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.511551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5032e40a-09cd-49e9-877e-6314167fefb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.515467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:14.516160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.516448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.517354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.518091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:14.518402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:14.520183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:14.524440 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 775/1542] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 12 14:33:14.525746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1833a-e8ee-4303-a51a-26da8da7cc40 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.526041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1833a-e8ee-4303-a51a-26da8da7cc40 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.526327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1833a-e8ee-4303-a51a-26da8da7cc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.541306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 768/1543] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:33:14.549520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-65b1833a-e8ee-4303-a51a-26da8da7cc40 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.550248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:14.555083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-65b1833a-e8ee-4303-a51a-26da8da7cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.569994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 776/1544] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.571467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6411c-0afb-42fd-a18d-3c6eaf570b46 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.571762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6411c-0afb-42fd-a18d-3c6eaf570b46 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.572044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6411c-0afb-42fd-a18d-3c6eaf570b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.572303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404d4e8-75aa-4461-b8b8-a237bf8caf16 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:14.591171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:14.591864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.592154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.592437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.593140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:14.594166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING py.warnings [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:33:14.594166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: warnings.warn(msg) Jul 12 14:33:14.594166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: Jul 12 14:33:14.595433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:14.596409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1ef6411c-0afb-42fd-a18d-3c6eaf570b46 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.597616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1ef6411c-0afb-42fd-a18d-3c6eaf570b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.612316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 777/1545] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.613971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a592-0986-4b97-8876-bb2adae3e8e0 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.614270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a592-0986-4b97-8876-bb2adae3e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.614555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a592-0986-4b97-8876-bb2adae3e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.646582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b5b2a592-0986-4b97-8876-bb2adae3e8e0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.647869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b5b2a592-0986-4b97-8876-bb2adae3e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.656772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 778/1546] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.658466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb6824-5869-471a-8b58-ed17b15c13b7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.658760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb6824-5869-471a-8b58-ed17b15c13b7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.659071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb6824-5869-471a-8b58-ed17b15c13b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.677270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 769/1547] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:33:14.678792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:14.694472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-57cb6824-5869-471a-8b58-ed17b15c13b7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.695948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-57cb6824-5869-471a-8b58-ed17b15c13b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.764435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 779/1548] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.765291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb6824-5869-471a-8b58-ed17b15c13b7 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:14.766730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d3226-3824-498c-93cd-4d11c8a25c2c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:14.774620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb6824-5869-471a-8b58-ed17b15c13b7 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:14.775159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1375-85c7-49c4-92a0-89a4f99fb2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:14.775832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1375-85c7-49c4-92a0-89a4f99fb2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.776122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1375-85c7-49c4-92a0-89a4f99fb2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.776402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1375-85c7-49c4-92a0-89a4f99fb2b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.777196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1375-85c7-49c4-92a0-89a4f99fb2b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:14.777503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1375-85c7-49c4-92a0-89a4f99fb2b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:14.779182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1375-85c7-49c4-92a0-89a4f99fb2b6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:14.779326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eb2b9-d828-4b84-a8cf-3c776421067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:14.779962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb2b9-d828-4b84-a8cf-3c776421067e admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.780250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb2b9-d828-4b84-a8cf-3c776421067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.780530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb2b9-d828-4b84-a8cf-3c776421067e admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.781266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eb2b9-d828-4b84-a8cf-3c776421067e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:14.781575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eb2b9-d828-4b84-a8cf-3c776421067e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:14.782628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING py.warnings [None req-9d8eb2b9-d828-4b84-a8cf-3c776421067e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:33:14.782628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: warnings.warn(msg) Jul 12 14:33:14.782628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: Jul 12 14:33:14.783788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eb2b9-d828-4b84-a8cf-3c776421067e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:14.791355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 770/1549] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:14.792612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc4d0-c355-4dfb-87ce-51a65b4e4961 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.792903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc4d0-c355-4dfb-87ce-51a65b4e4961 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.793182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc4d0-c355-4dfb-87ce-51a65b4e4961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.804506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 780/1550] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:14.805980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885a29-d04f-4187-83bc-2d43204ff6bf None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.806567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885a29-d04f-4187-83bc-2d43204ff6bf None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.806764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885a29-d04f-4187-83bc-2d43204ff6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.820166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2e5bc4d0-c355-4dfb-87ce-51a65b4e4961 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.821380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2e5bc4d0-c355-4dfb-87ce-51a65b4e4961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.826903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-45885a29-d04f-4187-83bc-2d43204ff6bf None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.828085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-45885a29-d04f-4187-83bc-2d43204ff6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.829332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 771/1551] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.830167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bc4d0-c355-4dfb-87ce-51a65b4e4961 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:14.840276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bc4d0-c355-4dfb-87ce-51a65b4e4961 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:14.843285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 781/1552] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.844635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866322-7852-46ac-afd3-215832051128 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.844960 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866322-7852-46ac-afd3-215832051128 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.845066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f812d-a623-4515-9868-3b124c08b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:14.845247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866322-7852-46ac-afd3-215832051128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.845689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f812d-a623-4515-9868-3b124c08b15e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.845979 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f812d-a623-4515-9868-3b124c08b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.846261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f812d-a623-4515-9868-3b124c08b15e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.846993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f812d-a623-4515-9868-3b124c08b15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:14.848904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f812d-a623-4515-9868-3b124c08b15e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:14.869784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-39866322-7852-46ac-afd3-215832051128 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.871061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-39866322-7852-46ac-afd3-215832051128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.874339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 772/1553] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:14.874339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f883b-e1ba-49fb-a206-edd558e1cb67 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.874339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f883b-e1ba-49fb-a206-edd558e1cb67 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.874339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f883b-e1ba-49fb-a206-edd558e1cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.879720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 782/1554] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.880974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135b04-0fce-4ec4-afbd-2a35d63a9150 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.882000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135b04-0fce-4ec4-afbd-2a35d63a9150 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.882000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135b04-0fce-4ec4-afbd-2a35d63a9150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.892605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9c2f883b-e1ba-49fb-a206-edd558e1cb67 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.893814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9c2f883b-e1ba-49fb-a206-edd558e1cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.899349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ef135b04-0fce-4ec4-afbd-2a35d63a9150 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.900558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ef135b04-0fce-4ec4-afbd-2a35d63a9150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.902397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 773/1555] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.903224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f883b-e1ba-49fb-a206-edd558e1cb67 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:14.908825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 783/1556] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:14.909497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef135b04-0fce-4ec4-afbd-2a35d63a9150 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:14.913769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f883b-e1ba-49fb-a206-edd558e1cb67 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:14.918334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef5a6-e91a-473c-8bff-f43dab754887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:14.918795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef135b04-0fce-4ec4-afbd-2a35d63a9150 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:14.919034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef5a6-e91a-473c-8bff-f43dab754887 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.919323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef5a6-e91a-473c-8bff-f43dab754887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.919605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef5a6-e91a-473c-8bff-f43dab754887 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.920300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef5a6-e91a-473c-8bff-f43dab754887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:14.922239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef5a6-e91a-473c-8bff-f43dab754887 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:14.923818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6731c-fd99-4de1-8dcb-e5e23f7479f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:14.924485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6731c-fd99-4de1-8dcb-e5e23f7479f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.924768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6731c-fd99-4de1-8dcb-e5e23f7479f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.925043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6731c-fd99-4de1-8dcb-e5e23f7479f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.925724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6731c-fd99-4de1-8dcb-e5e23f7479f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:14.927644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6731c-fd99-4de1-8dcb-e5e23f7479f1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:14.949683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 774/1557] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:14.950998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0056-f667-42eb-905d-62325168a6b9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.951368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0056-f667-42eb-905d-62325168a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.951582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0056-f667-42eb-905d-62325168a6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.958402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 784/1558] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:14.959766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9501-2e28-48c0-bd06-b74802f94f53 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:14.960064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9501-2e28-48c0-bd06-b74802f94f53 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:14.960356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9501-2e28-48c0-bd06-b74802f94f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:14.969693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0dea0056-f667-42eb-905d-62325168a6b9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.970961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0dea0056-f667-42eb-905d-62325168a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:14.977773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f64d9501-2e28-48c0-bd06-b74802f94f53 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:14.978983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f64d9501-2e28-48c0-bd06-b74802f94f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:15.016425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:15.033821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 775/1559] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:15.035430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea0056-f667-42eb-905d-62325168a6b9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.038906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 785/1560] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:15.040245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f08e-813c-4f4b-8446-7e53e2232238 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.040624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f08e-813c-4f4b-8446-7e53e2232238 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.040853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f08e-813c-4f4b-8446-7e53e2232238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.046977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea0056-f667-42eb-905d-62325168a6b9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.052198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0961c2-c7ea-4e2f-88f8-33940d964367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.052875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0961c2-c7ea-4e2f-88f8-33940d964367 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.053167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0961c2-c7ea-4e2f-88f8-33940d964367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.053450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0961c2-c7ea-4e2f-88f8-33940d964367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.054184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0961c2-c7ea-4e2f-88f8-33940d964367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.055825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0961c2-c7ea-4e2f-88f8-33940d964367 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.063554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-9f40f08e-813c-4f4b-8446-7e53e2232238 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:15.065269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9f40f08e-813c-4f4b-8446-7e53e2232238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:15.071118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 776/1561] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:15.071118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0961c2-c7ea-4e2f-88f8-33940d964367 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.075926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 786/1562] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:15.080186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d71d4-dd2b-4c32-8499-f955f9f181ff None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.080483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d71d4-dd2b-4c32-8499-f955f9f181ff None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.080593 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0961c2-c7ea-4e2f-88f8-33940d964367 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.080769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d71d4-dd2b-4c32-8499-f955f9f181ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.085144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.085791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.086084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.086371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.087344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:15.088499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.090119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.092925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:15.099643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-065d71d4-dd2b-4c32-8499-f955f9f181ff None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:15.101619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-065d71d4-dd2b-4c32-8499-f955f9f181ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:15.103346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 777/1563] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:15.104139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.114261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516db00-fdce-4812-9cd0-cee5af066853 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.117522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 787/1564] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:15.118434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d71d4-dd2b-4c32-8499-f955f9f181ff None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.122184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b9378-0f5f-4de4-9e60-00995c1de467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.122910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b9378-0f5f-4de4-9e60-00995c1de467 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.123204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b9378-0f5f-4de4-9e60-00995c1de467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.123515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b9378-0f5f-4de4-9e60-00995c1de467 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.124174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b9378-0f5f-4de4-9e60-00995c1de467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.126090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b9378-0f5f-4de4-9e60-00995c1de467 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.127903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d71d4-dd2b-4c32-8499-f955f9f181ff None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.132430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.133089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.133381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.133665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.134344 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.135451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING py.warnings [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:33:15.135451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: warnings.warn(msg) Jul 12 14:33:15.135451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: Jul 12 14:33:15.136857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.146630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 778/1565] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.147908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b9378-0f5f-4de4-9e60-00995c1de467 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.159422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b9378-0f5f-4de4-9e60-00995c1de467 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.164074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.167320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 788/1566] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.167467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.167467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.167467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.167693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.167786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:15.167786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.167938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.175300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d490b-082e-409d-b5c2-500ef2f46586 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.179835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.180480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.180779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.188140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 779/1567] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:15.188241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.188326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.188461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:15.188461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.188461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.191053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036993a0-cd8d-44e5-87ae-921bd13aeacc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.196492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fb0e3-6710-442d-b644-4a8a57a485a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.197270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fb0e3-6710-442d-b644-4a8a57a485a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.197561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fb0e3-6710-442d-b644-4a8a57a485a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.197840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fb0e3-6710-442d-b644-4a8a57a485a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.198559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fb0e3-6710-442d-b644-4a8a57a485a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.199436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 789/1568] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:15.200322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fb0e3-6710-442d-b644-4a8a57a485a0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.200450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.211537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715ef79-92f3-473f-a9e1-11472718897a admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.217040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 780/1569] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:15.217040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fb0e3-6710-442d-b644-4a8a57a485a0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.217310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.217310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.217518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.217653 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.218380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:15.218697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.220876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.226120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fb0e3-6710-442d-b644-4a8a57a485a0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.231387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6142c6-105e-412e-90fc-ba11db0f0ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.232031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6142c6-105e-412e-90fc-ba11db0f0ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.232327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6142c6-105e-412e-90fc-ba11db0f0ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.232610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6142c6-105e-412e-90fc-ba11db0f0ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.240817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 790/1570] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:15.240970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6142c6-105e-412e-90fc-ba11db0f0ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.241086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.241189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6142c6-105e-412e-90fc-ba11db0f0ac8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.250368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda7771-fb8e-45a2-85ef-574e30e6a151 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.256076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.256737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.257026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.257303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.258026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:15.258330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.260000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.266192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 781/1571] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.266192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6142c6-105e-412e-90fc-ba11db0f0ac8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.279698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 791/1572] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:15.279698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.289651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff68490-bf08-4820-8c5c-0199835063e8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.326466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6142c6-105e-412e-90fc-ba11db0f0ac8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.331284 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3027c87-204a-47b1-85f3-8a51358b9941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.331960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027c87-204a-47b1-85f3-8a51358b9941 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.332254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027c87-204a-47b1-85f3-8a51358b9941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.332538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027c87-204a-47b1-85f3-8a51358b9941 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.333269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3027c87-204a-47b1-85f3-8a51358b9941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.334967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3027c87-204a-47b1-85f3-8a51358b9941 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.345321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 782/1573] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:15.346095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3027c87-204a-47b1-85f3-8a51358b9941 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.349280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cfaa1-6fb1-4e17-aedf-dc9ed69d44be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.349988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cfaa1-6fb1-4e17-aedf-dc9ed69d44be admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.350279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cfaa1-6fb1-4e17-aedf-dc9ed69d44be admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.350559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cfaa1-6fb1-4e17-aedf-dc9ed69d44be admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.351320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cfaa1-6fb1-4e17-aedf-dc9ed69d44be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.352933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9cfaa1-6fb1-4e17-aedf-dc9ed69d44be admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.361083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3027c87-204a-47b1-85f3-8a51358b9941 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.366378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 792/1574] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:15.366378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cfaa1-6fb1-4e17-aedf-dc9ed69d44be admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.366575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce2d45-8afb-463b-9669-eba3bc552ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.366575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce2d45-8afb-463b-9669-eba3bc552ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.366819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce2d45-8afb-463b-9669-eba3bc552ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.366962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce2d45-8afb-463b-9669-eba3bc552ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.367649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce2d45-8afb-463b-9669-eba3bc552ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.369524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce2d45-8afb-463b-9669-eba3bc552ba0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.373677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cfaa1-6fb1-4e17-aedf-dc9ed69d44be admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.378412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0e2fa-1ca9-4c16-a4d1-2251a1c20a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.379081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0e2fa-1ca9-4c16-a4d1-2251a1c20a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.379379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0e2fa-1ca9-4c16-a4d1-2251a1c20a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.379670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0e2fa-1ca9-4c16-a4d1-2251a1c20a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.380347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0e2fa-1ca9-4c16-a4d1-2251a1c20a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.382242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0e2fa-1ca9-4c16-a4d1-2251a1c20a63 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.399043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 783/1575] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.399043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce2d45-8afb-463b-9669-eba3bc552ba0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.414964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 793/1576] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.416191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0e2fa-1ca9-4c16-a4d1-2251a1c20a63 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.440385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:15.463123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce2d45-8afb-463b-9669-eba3bc552ba0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.477271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0e2fa-1ca9-4c16-a4d1-2251a1c20a63 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.481867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75bf3c-04aa-456b-86f9-978852a465b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.482520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bf3c-04aa-456b-86f9-978852a465b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.482835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bf3c-04aa-456b-86f9-978852a465b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.483115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bf3c-04aa-456b-86f9-978852a465b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.483794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75bf3c-04aa-456b-86f9-978852a465b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.485728 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75bf3c-04aa-456b-86f9-978852a465b8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.511982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 794/1577] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.513111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75bf3c-04aa-456b-86f9-978852a465b8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.517800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:15.521979 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.523013 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.523296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.523867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] PATH_INFO: `/v3/projects/590d617afb4e41678fb89d6130fa4a79/users/3522c9dae7854c2395b6a00a9094b10e/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.539671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590d617afb4e41678fb89d6130fa4a79, user_id=3522c9dae7854c2395b6a00a9094b10e, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.540801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING py.warnings [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:33:15.540801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: warnings.warn(msg) Jul 12 14:33:15.540801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: Jul 12 14:33:15.542835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.556197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 784/1578] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:15 2022] PUT /identity/v3/projects/590d617afb4e41678fb89d6130fa4a79/users/3522c9dae7854c2395b6a00a9094b10e/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:15.557085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.580939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75bf3c-04aa-456b-86f9-978852a465b8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.618030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc225d-d827-4336-83bd-fa4d81ede340 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.622590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb133-f78a-4cfb-b571-baaaa0e7e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.623275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb133-f78a-4cfb-b571-baaaa0e7e3db admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.623562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb133-f78a-4cfb-b571-baaaa0e7e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.623839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb133-f78a-4cfb-b571-baaaa0e7e3db admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.624520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebb133-f78a-4cfb-b571-baaaa0e7e3db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.626437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebb133-f78a-4cfb-b571-baaaa0e7e3db admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.636028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722723d1-aa39-4480-9c5b-9271edc8c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.636703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722723d1-aa39-4480-9c5b-9271edc8c5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.636998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722723d1-aa39-4480-9c5b-9271edc8c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.637268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722723d1-aa39-4480-9c5b-9271edc8c5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.637926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722723d1-aa39-4480-9c5b-9271edc8c5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.639939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722723d1-aa39-4480-9c5b-9271edc8c5a7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.652024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 785/1579] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.652986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb133-f78a-4cfb-b571-baaaa0e7e3db admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.666229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 795/1580] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.667137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722723d1-aa39-4480-9c5b-9271edc8c5a7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.676338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722723d1-aa39-4480-9c5b-9271edc8c5a7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.707350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:15.719347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb133-f78a-4cfb-b571-baaaa0e7e3db admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.724527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb029e7a-86e9-4226-8c87-390ad5a171df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.725197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb029e7a-86e9-4226-8c87-390ad5a171df admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.725485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb029e7a-86e9-4226-8c87-390ad5a171df admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.725762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb029e7a-86e9-4226-8c87-390ad5a171df admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.726484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb029e7a-86e9-4226-8c87-390ad5a171df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.728111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb029e7a-86e9-4226-8c87-390ad5a171df admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.733059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f72872-6d86-430b-9f43-2f22be522290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.733739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72872-6d86-430b-9f43-2f22be522290 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.734140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72872-6d86-430b-9f43-2f22be522290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.734428 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72872-6d86-430b-9f43-2f22be522290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.735201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f72872-6d86-430b-9f43-2f22be522290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.736868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f72872-6d86-430b-9f43-2f22be522290 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.738062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 786/1581] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:15.738835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb029e7a-86e9-4226-8c87-390ad5a171df admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.750759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 796/1582] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:15.750759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f72872-6d86-430b-9f43-2f22be522290 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.751026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb029e7a-86e9-4226-8c87-390ad5a171df admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.753453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041eb6b0-2190-4766-bfa9-75fe0ff406a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.754108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eb6b0-2190-4766-bfa9-75fe0ff406a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.754860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eb6b0-2190-4766-bfa9-75fe0ff406a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.754860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eb6b0-2190-4766-bfa9-75fe0ff406a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.755365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041eb6b0-2190-4766-bfa9-75fe0ff406a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.757260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041eb6b0-2190-4766-bfa9-75fe0ff406a7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.758028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f72872-6d86-430b-9f43-2f22be522290 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.762681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aef96-3ad7-425d-9f29-214dc3c1e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.763352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef96-3ad7-425d-9f29-214dc3c1e334 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.763720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef96-3ad7-425d-9f29-214dc3c1e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.763922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aef96-3ad7-425d-9f29-214dc3c1e334 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.764596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aef96-3ad7-425d-9f29-214dc3c1e334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.767237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aef96-3ad7-425d-9f29-214dc3c1e334 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.777395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 787/1583] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/users => generated 295 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.778260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041eb6b0-2190-4766-bfa9-75fe0ff406a7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.788822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041eb6b0-2190-4766-bfa9-75fe0ff406a7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.793523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a67e-d274-4419-a7da-97c42071997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.793660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 797/1584] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.794240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a67e-d274-4419-a7da-97c42071997e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.794533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a67e-d274-4419-a7da-97c42071997e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.794841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a67e-d274-4419-a7da-97c42071997e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.794941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9b30f-2cc1-4168-b5c2-64089f86c1a4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.795221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9b30f-2cc1-4168-b5c2-64089f86c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.795512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9b30f-2cc1-4168-b5c2-64089f86c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.795616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5a67e-d274-4419-a7da-97c42071997e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.797421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5a67e-d274-4419-a7da-97c42071997e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.814699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-44d9b30f-2cc1-4168-b5c2-64089f86c1a4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:15.815956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-44d9b30f-2cc1-4168-b5c2-64089f86c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:15.817817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 788/1585] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.818604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a67e-d274-4419-a7da-97c42071997e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.823703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 798/1586] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:15.824482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9b30f-2cc1-4168-b5c2-64089f86c1a4 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.834235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9b30f-2cc1-4168-b5c2-64089f86c1a4 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.837056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a67e-d274-4419-a7da-97c42071997e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.839014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bb22-7559-4513-b004-0d06f53274db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.839665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bb22-7559-4513-b004-0d06f53274db admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.839983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bb22-7559-4513-b004-0d06f53274db admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.840289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bb22-7559-4513-b004-0d06f53274db admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.841022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bb22-7559-4513-b004-0d06f53274db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.842066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70170cb-c76b-4c4c-9554-aa727a2a7716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.842630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bb22-7559-4513-b004-0d06f53274db admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.842756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70170cb-c76b-4c4c-9554-aa727a2a7716 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.843037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70170cb-c76b-4c4c-9554-aa727a2a7716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.843309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70170cb-c76b-4c4c-9554-aa727a2a7716 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.843994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70170cb-c76b-4c4c-9554-aa727a2a7716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.846396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70170cb-c76b-4c4c-9554-aa727a2a7716 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.848467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:15.853703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 799/1587] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:15.855023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bb22-7559-4513-b004-0d06f53274db admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.869517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bb22-7559-4513-b004-0d06f53274db admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.870370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 789/1588] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:15 2022] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:15.871439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70170cb-c76b-4c4c-9554-aa727a2a7716 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.875790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ca96f-97b8-4c28-87b9-d88127c0e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.876815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca96f-97b8-4c28-87b9-d88127c0e0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.877170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca96f-97b8-4c28-87b9-d88127c0e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.877537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca96f-97b8-4c28-87b9-d88127c0e0d5 admin admin] PATH_INFO: `/v3/projects/fc4a4f6af6ea405fac0ee8fb191d41ff/users/a0794c7a4d5e416caccfa3bd6ce5ea17/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.881545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70170cb-c76b-4c4c-9554-aa727a2a7716 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.886140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daefa62-8322-44c6-a55d-44f45d8c5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.887035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daefa62-8322-44c6-a55d-44f45d8c5b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.887319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daefa62-8322-44c6-a55d-44f45d8c5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.887598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daefa62-8322-44c6-a55d-44f45d8c5b0c admin admin] PATH_INFO: `/v3/projects/f72b6318e4224f2398bcb2e6196d1646/users/f7d1211692ff4672ad74c31a5780b37f/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.893150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ca96f-97b8-4c28-87b9-d88127c0e0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4a4f6af6ea405fac0ee8fb191d41ff, user_id=a0794c7a4d5e416caccfa3bd6ce5ea17, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.895875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ca96f-97b8-4c28-87b9-d88127c0e0d5 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.902457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daefa62-8322-44c6-a55d-44f45d8c5b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72b6318e4224f2398bcb2e6196d1646, user_id=f7d1211692ff4672ad74c31a5780b37f, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.905361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daefa62-8322-44c6-a55d-44f45d8c5b0c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:15.910093 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 800/1589] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:15 2022] PUT /identity/v3/projects/fc4a4f6af6ea405fac0ee8fb191d41ff/users/a0794c7a4d5e416caccfa3bd6ce5ea17/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:15.910934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ca96f-97b8-4c28-87b9-d88127c0e0d5 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.923469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 790/1590] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:15 2022] PUT /identity/v3/projects/f72b6318e4224f2398bcb2e6196d1646/users/f7d1211692ff4672ad74c31a5780b37f/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:15.924286 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daefa62-8322-44c6-a55d-44f45d8c5b0c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:15.972752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ca96f-97b8-4c28-87b9-d88127c0e0d5 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.986159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daefa62-8322-44c6-a55d-44f45d8c5b0c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:15.990794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9737f-8ebe-4732-a109-6eb0c6e86dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:15.991464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9737f-8ebe-4732-a109-6eb0c6e86dac admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:15.991756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9737f-8ebe-4732-a109-6eb0c6e86dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:15.992041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9737f-8ebe-4732-a109-6eb0c6e86dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:15.992778 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9737f-8ebe-4732-a109-6eb0c6e86dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:15.994429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9737f-8ebe-4732-a109-6eb0c6e86dac admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.004104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 791/1591] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.004894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9737f-8ebe-4732-a109-6eb0c6e86dac admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.014133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9737f-8ebe-4732-a109-6eb0c6e86dac admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.018843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecbef2-1208-493b-9c70-490b6d3b11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.019489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecbef2-1208-493b-9c70-490b6d3b11e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.019784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecbef2-1208-493b-9c70-490b6d3b11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.020067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecbef2-1208-493b-9c70-490b6d3b11e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.020784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecbef2-1208-493b-9c70-490b6d3b11e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.022350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecbef2-1208-493b-9c70-490b6d3b11e1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.029053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ab4b1-185d-48fc-be66-9ff929f7628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.029725 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab4b1-185d-48fc-be66-9ff929f7628f admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.030012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab4b1-185d-48fc-be66-9ff929f7628f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.030291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab4b1-185d-48fc-be66-9ff929f7628f admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.031057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ab4b1-185d-48fc-be66-9ff929f7628f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.035815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 792/1592] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.035981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ab4b1-185d-48fc-be66-9ff929f7628f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.036083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecbef2-1208-493b-9c70-490b6d3b11e1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.046736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 801/1593] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.046736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ab4b1-185d-48fc-be66-9ff929f7628f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.056403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ab4b1-185d-48fc-be66-9ff929f7628f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.061357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bc57d-cbe8-42e1-a4a3-bd00c8038e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.062016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bc57d-cbe8-42e1-a4a3-bd00c8038e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.062306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bc57d-cbe8-42e1-a4a3-bd00c8038e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.062585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bc57d-cbe8-42e1-a4a3-bd00c8038e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.063337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bc57d-cbe8-42e1-a4a3-bd00c8038e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.064990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bc57d-cbe8-42e1-a4a3-bd00c8038e04 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.075025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 802/1594] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.075859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bc57d-cbe8-42e1-a4a3-bd00c8038e04 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.085471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bc57d-cbe8-42e1-a4a3-bd00c8038e04 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.090261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c5da-b287-4412-b072-a507e428a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.090984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c5da-b287-4412-b072-a507e428a229 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.091280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c5da-b287-4412-b072-a507e428a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.091567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c5da-b287-4412-b072-a507e428a229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.092290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c5da-b287-4412-b072-a507e428a229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.093874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c5da-b287-4412-b072-a507e428a229 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.094172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecbef2-1208-493b-9c70-490b6d3b11e1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.098308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd795b-52c1-445c-97a5-09f52a7fde89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.099003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd795b-52c1-445c-97a5-09f52a7fde89 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.099297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd795b-52c1-445c-97a5-09f52a7fde89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.099561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd795b-52c1-445c-97a5-09f52a7fde89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.106173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 803/1595] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.107577 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e861c-0e34-4d64-b694-1e01fb74c233 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.107993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e861c-0e34-4d64-b694-1e01fb74c233 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.108576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e861c-0e34-4d64-b694-1e01fb74c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.109024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd795b-52c1-445c-97a5-09f52a7fde89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.111047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd795b-52c1-445c-97a5-09f52a7fde89 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.116094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:16.121675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 793/1596] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:16.123494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d581bf-c80f-4d09-9719-55cd2781ed9a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.123997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d581bf-c80f-4d09-9719-55cd2781ed9a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.124547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d581bf-c80f-4d09-9719-55cd2781ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.127032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-616e861c-0e34-4d64-b694-1e01fb74c233 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:16.128363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-616e861c-0e34-4d64-b694-1e01fb74c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:16.136555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 804/1597] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:16.139848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e861c-0e34-4d64-b694-1e01fb74c233 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.147868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e861c-0e34-4d64-b694-1e01fb74c233 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.153038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39453d0-2eed-4edf-883b-c7bde4ffa79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.153709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39453d0-2eed-4edf-883b-c7bde4ffa79b admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.154067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39453d0-2eed-4edf-883b-c7bde4ffa79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.154256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39453d0-2eed-4edf-883b-c7bde4ffa79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.155022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39453d0-2eed-4edf-883b-c7bde4ffa79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.156636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39453d0-2eed-4edf-883b-c7bde4ffa79b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.168456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-61d581bf-c80f-4d09-9719-55cd2781ed9a None None] MFA Rules not processed for user `f7d1211692ff4672ad74c31a5780b37f`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:16.169687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-61d581bf-c80f-4d09-9719-55cd2781ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:16.172381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 805/1598] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.173332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39453d0-2eed-4edf-883b-c7bde4ffa79b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.184431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39453d0-2eed-4edf-883b-c7bde4ffa79b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.189880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff8641-2ea1-4265-85a7-a05ecba2702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.190670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff8641-2ea1-4265-85a7-a05ecba2702b admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.190995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff8641-2ea1-4265-85a7-a05ecba2702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.191288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff8641-2ea1-4265-85a7-a05ecba2702b admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.192212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff8641-2ea1-4265-85a7-a05ecba2702b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.194505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff8641-2ea1-4265-85a7-a05ecba2702b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.212138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 806/1599] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.212138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff8641-2ea1-4265-85a7-a05ecba2702b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.224939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff8641-2ea1-4265-85a7-a05ecba2702b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.230615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15160-fba7-421a-bb69-4fc0db77f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.231351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15160-fba7-421a-bb69-4fc0db77f512 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.231639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15160-fba7-421a-bb69-4fc0db77f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.231914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15160-fba7-421a-bb69-4fc0db77f512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.232844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15160-fba7-421a-bb69-4fc0db77f512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.235155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15160-fba7-421a-bb69-4fc0db77f512 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.243108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 794/1600] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:16.243897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d581bf-c80f-4d09-9719-55cd2781ed9a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.249417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 807/1601] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.249417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15160-fba7-421a-bb69-4fc0db77f512 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.256837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d581bf-c80f-4d09-9719-55cd2781ed9a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.260813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15160-fba7-421a-bb69-4fc0db77f512 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.262397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc4f62-d249-4e3d-971b-24e08db788da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.263461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4f62-d249-4e3d-971b-24e08db788da admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.263786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4f62-d249-4e3d-971b-24e08db788da admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.264100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4f62-d249-4e3d-971b-24e08db788da admin admin] PATH_INFO: `/v3/projects/ead62006ce2c419ab76d5dfdea0a189b/users/27cbfa54860940bc84e576943c0b9503/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.267836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c222c-276a-4b06-841e-69d26c22bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.268717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c222c-276a-4b06-841e-69d26c22bc05 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.269008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c222c-276a-4b06-841e-69d26c22bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.269337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c222c-276a-4b06-841e-69d26c22bc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.270184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c222c-276a-4b06-841e-69d26c22bc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.271992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c222c-276a-4b06-841e-69d26c22bc05 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.288147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 808/1602] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:16.288341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc4f62-d249-4e3d-971b-24e08db788da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead62006ce2c419ab76d5dfdea0a189b, user_id=27cbfa54860940bc84e576943c0b9503, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.290668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc4f62-d249-4e3d-971b-24e08db788da admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.291103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c222c-276a-4b06-841e-69d26c22bc05 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.301956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c222c-276a-4b06-841e-69d26c22bc05 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.304787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 795/1603] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:16 2022] PUT /identity/v3/projects/ead62006ce2c419ab76d5dfdea0a189b/users/27cbfa54860940bc84e576943c0b9503/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:16.308700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc4f62-d249-4e3d-971b-24e08db788da admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.309463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:16.363409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673139-5227-46fb-98d7-4031b4f5e36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.364063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673139-5227-46fb-98d7-4031b4f5e36e service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.364354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673139-5227-46fb-98d7-4031b4f5e36e service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.364753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673139-5227-46fb-98d7-4031b4f5e36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.383247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc4f62-d249-4e3d-971b-24e08db788da admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.388354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0044d6-b22d-4e23-b018-74df2420f04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.389362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0044d6-b22d-4e23-b018-74df2420f04d admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.389749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0044d6-b22d-4e23-b018-74df2420f04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.390145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0044d6-b22d-4e23-b018-74df2420f04d admin admin] PATH_INFO: `/v3/projects/361ecfe3ee4b4ed1855d741f57f00ba5/users/4adff04fdbea4d9c9eccda6538974d62/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.407985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0044d6-b22d-4e23-b018-74df2420f04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=361ecfe3ee4b4ed1855d741f57f00ba5, user_id=4adff04fdbea4d9c9eccda6538974d62, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.411183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0044d6-b22d-4e23-b018-74df2420f04d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.427001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 796/1604] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:16 2022] PUT /identity/v3/projects/361ecfe3ee4b4ed1855d741f57f00ba5/users/4adff04fdbea4d9c9eccda6538974d62/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:16.427858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0044d6-b22d-4e23-b018-74df2420f04d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.436811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc673139-5227-46fb-98d7-4031b4f5e36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.440586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc673139-5227-46fb-98d7-4031b4f5e36e service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.455693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 809/1605] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:16.457021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673139-5227-46fb-98d7-4031b4f5e36e service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.468247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673139-5227-46fb-98d7-4031b4f5e36e service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.492430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:16.515738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0044d6-b22d-4e23-b018-74df2420f04d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.525984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044b730-7384-4498-af84-14f6783c9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.528224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044b730-7384-4498-af84-14f6783c9488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.528669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044b730-7384-4498-af84-14f6783c9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.529211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044b730-7384-4498-af84-14f6783c9488 admin admin] PATH_INFO: `/v3/projects/aa015fea356346faa8efed67ace71e4e/users/59284686eacc4f47a8ab483665157c6b/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.553334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044b730-7384-4498-af84-14f6783c9488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa015fea356346faa8efed67ace71e4e, user_id=59284686eacc4f47a8ab483665157c6b, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.557511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044b730-7384-4498-af84-14f6783c9488 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.574042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e8749-8e29-4d1a-a72a-0331e0fd4443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.575279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e8749-8e29-4d1a-a72a-0331e0fd4443 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.577146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e8749-8e29-4d1a-a72a-0331e0fd4443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.577146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e8749-8e29-4d1a-a72a-0331e0fd4443 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.577146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e8749-8e29-4d1a-a72a-0331e0fd4443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.578698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 797/1606] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:16 2022] PUT /identity/v3/projects/aa015fea356346faa8efed67ace71e4e/users/59284686eacc4f47a8ab483665157c6b/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:16.580421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044b730-7384-4498-af84-14f6783c9488 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.587695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e8749-8e29-4d1a-a72a-0331e0fd4443 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.619114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 810/1607] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:16 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:16.620290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e8749-8e29-4d1a-a72a-0331e0fd4443 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.668256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044b730-7384-4498-af84-14f6783c9488 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.678261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:16.703602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e8749-8e29-4d1a-a72a-0331e0fd4443 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:16.708914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9259-b52f-4263-a319-1664cdf664b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.709937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9259-b52f-4263-a319-1664cdf664b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.710235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9259-b52f-4263-a319-1664cdf664b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.710515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9259-b52f-4263-a319-1664cdf664b0 admin admin] PATH_INFO: `/v3/projects/9484b1922f154ccbabe36511f8556b26/users/d26a45c9783448a9ab6deef8fdb5cd3a/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.729030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b9259-b52f-4263-a319-1664cdf664b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9484b1922f154ccbabe36511f8556b26, user_id=d26a45c9783448a9ab6deef8fdb5cd3a, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.731641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b9259-b52f-4263-a319-1664cdf664b0 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.747011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc876377-c9e3-4cb7-a243-e7a54e23c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:16.751561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 811/1608] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:16 2022] PUT /identity/v3/projects/9484b1922f154ccbabe36511f8556b26/users/d26a45c9783448a9ab6deef8fdb5cd3a/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:16.751770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876377-c9e3-4cb7-a243-e7a54e23c7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.751770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876377-c9e3-4cb7-a243-e7a54e23c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.751770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876377-c9e3-4cb7-a243-e7a54e23c7a5 admin admin] PATH_INFO: `/v3/projects/15202d29e843404490b7cfffcde73640/users/4019001e534148e69c25c4d84b3a7f6e/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.751995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6ec7-b5a1-4df4-8ff6-06c2fc3c2b00 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.751995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6ec7-b5a1-4df4-8ff6-06c2fc3c2b00 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.751995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6ec7-b5a1-4df4-8ff6-06c2fc3c2b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.774380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc876377-c9e3-4cb7-a243-e7a54e23c7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15202d29e843404490b7cfffcde73640, user_id=4019001e534148e69c25c4d84b3a7f6e, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:16.777772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc876377-c9e3-4cb7-a243-e7a54e23c7a5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:16.777920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-828e6ec7-b5a1-4df4-8ff6-06c2fc3c2b00 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:16.778557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-828e6ec7-b5a1-4df4-8ff6-06c2fc3c2b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:16.794330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 798/1609] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:16 2022] PUT /identity/v3/projects/15202d29e843404490b7cfffcde73640/users/4019001e534148e69c25c4d84b3a7f6e/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:16.795766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6d92-92b7-4e4d-9c19-c37a7b89220f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.796141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6d92-92b7-4e4d-9c19-c37a7b89220f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.796470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6d92-92b7-4e4d-9c19-c37a7b89220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.826851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-607f6d92-92b7-4e4d-9c19-c37a7b89220f None None] MFA Rules not processed for user `4adff04fdbea4d9c9eccda6538974d62`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:16.828311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-607f6d92-92b7-4e4d-9c19-c37a7b89220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:16.855396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 812/1610] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:16.858870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908364c-f1af-42c3-ae50-b159636427cd None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.858870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908364c-f1af-42c3-ae50-b159636427cd None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.858870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908364c-f1af-42c3-ae50-b159636427cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:16.888055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:16.890676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a908364c-f1af-42c3-ae50-b159636427cd None None] MFA Rules not processed for user `59284686eacc4f47a8ab483665157c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:16.892053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a908364c-f1af-42c3-ae50-b159636427cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:16.910750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 799/1611] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:16.911928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6d92-92b7-4e4d-9c19-c37a7b89220f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:16.985135 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 813/1612] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:16.990014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664147ce-cc17-4e90-a9d5-a32ebd5a5502 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:16.990014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664147ce-cc17-4e90-a9d5-a32ebd5a5502 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:16.990014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664147ce-cc17-4e90-a9d5-a32ebd5a5502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.004606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6d92-92b7-4e4d-9c19-c37a7b89220f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.010928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924685a-af2e-4324-9521-9a5a2d6dbce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.011650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924685a-af2e-4324-9521-9a5a2d6dbce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.014798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924685a-af2e-4324-9521-9a5a2d6dbce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.014798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924685a-af2e-4324-9521-9a5a2d6dbce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.014798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924685a-af2e-4324-9521-9a5a2d6dbce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.015639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924685a-af2e-4324-9521-9a5a2d6dbce8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:17.019038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-664147ce-cc17-4e90-a9d5-a32ebd5a5502 None None] MFA Rules not processed for user `d26a45c9783448a9ab6deef8fdb5cd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:17.020649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-664147ce-cc17-4e90-a9d5-a32ebd5a5502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:17.053250 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 800/1613] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:16 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:17.070319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063720-7289-4965-afa7-1f95ad44a2da None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.070900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063720-7289-4965-afa7-1f95ad44a2da None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.071237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063720-7289-4965-afa7-1f95ad44a2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.096703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:17.098090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f1063720-7289-4965-afa7-1f95ad44a2da None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:17.099400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f1063720-7289-4965-afa7-1f95ad44a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:17.116544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 801/1614] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:17.117437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1063720-7289-4965-afa7-1f95ad44a2da None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.152743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 814/1615] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:17.154417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664147ce-cc17-4e90-a9d5-a32ebd5a5502 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.170511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664147ce-cc17-4e90-a9d5-a32ebd5a5502 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.176129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56344ca0-1125-40ed-bdf7-3f68e977c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.177144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344ca0-1125-40ed-bdf7-3f68e977c3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.177936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344ca0-1125-40ed-bdf7-3f68e977c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.178229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344ca0-1125-40ed-bdf7-3f68e977c3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.179421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56344ca0-1125-40ed-bdf7-3f68e977c3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.181802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56344ca0-1125-40ed-bdf7-3f68e977c3a7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:17.224561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1063720-7289-4965-afa7-1f95ad44a2da None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.232951 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87432d-7ba4-482e-a57d-5524db01dd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.233678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87432d-7ba4-482e-a57d-5524db01dd3d service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.234451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87432d-7ba4-482e-a57d-5524db01dd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.234584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87432d-7ba4-482e-a57d-5524db01dd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.240464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 815/1616] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:17 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:17.241848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ec42-847d-420b-9265-ee271329930a None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.243304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ec42-847d-420b-9265-ee271329930a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.243304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ec42-847d-420b-9265-ee271329930a None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.248703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 816/1617] 10.222.0.72 () {54 vars in 961 bytes} [Tue Jul 12 14:33:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:17.249589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ec42-847d-420b-9265-ee271329930a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.252345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87432d-7ba4-482e-a57d-5524db01dd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.254300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87432d-7ba4-482e-a57d-5524db01dd3d service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:17.268097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 802/1618] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:17.270405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87432d-7ba4-482e-a57d-5524db01dd3d service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.288221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87432d-7ba4-482e-a57d-5524db01dd3d service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.360774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3a625-2f76-457e-92e3-13c313cd8b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.360774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a625-2f76-457e-92e3-13c313cd8b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.360774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a625-2f76-457e-92e3-13c313cd8b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.360774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a625-2f76-457e-92e3-13c313cd8b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.402563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ec42-847d-420b-9265-ee271329930a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.414074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc422bf-3008-48fa-b336-ca35f997d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.414781 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc422bf-3008-48fa-b336-ca35f997d99f admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.415074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc422bf-3008-48fa-b336-ca35f997d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.415422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc422bf-3008-48fa-b336-ca35f997d99f admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.416776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc422bf-3008-48fa-b336-ca35f997d99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.418469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc422bf-3008-48fa-b336-ca35f997d99f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:17.420974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:17.453068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 817/1619] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:17.455202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc422bf-3008-48fa-b336-ca35f997d99f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.469771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3a625-2f76-457e-92e3-13c313cd8b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.471926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3a625-2f76-457e-92e3-13c313cd8b0e service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:17.481348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc422bf-3008-48fa-b336-ca35f997d99f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.485576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 803/1620] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:17.486892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3a625-2f76-457e-92e3-13c313cd8b0e service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.487544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557644c-8d2a-4ac5-a50a-5e8566f4582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.488226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557644c-8d2a-4ac5-a50a-5e8566f4582f admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.488993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557644c-8d2a-4ac5-a50a-5e8566f4582f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.489273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557644c-8d2a-4ac5-a50a-5e8566f4582f admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.489987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557644c-8d2a-4ac5-a50a-5e8566f4582f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.492219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557644c-8d2a-4ac5-a50a-5e8566f4582f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:17.502101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3a625-2f76-457e-92e3-13c313cd8b0e service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.508683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893b91-b862-4be1-b9e3-89d0e3a0c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.509770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893b91-b862-4be1-b9e3-89d0e3a0c4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.510578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893b91-b862-4be1-b9e3-89d0e3a0c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.511125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47893b91-b862-4be1-b9e3-89d0e3a0c4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.512449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47893b91-b862-4be1-b9e3-89d0e3a0c4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.515091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47893b91-b862-4be1-b9e3-89d0e3a0c4c4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:17.544563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 818/1621] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:17 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:17.546866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54cd8f-fdd6-46fe-94b9-e489d0fc8d14 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.547176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54cd8f-fdd6-46fe-94b9-e489d0fc8d14 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.547479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54cd8f-fdd6-46fe-94b9-e489d0fc8d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.554324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 804/1622] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:17 2022] POST /identity/v3/users => generated 296 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:17.556134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893b91-b862-4be1-b9e3-89d0e3a0c4c4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.569866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47893b91-b862-4be1-b9e3-89d0e3a0c4c4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.651959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0324883-5328-44ee-b21e-37ed25c8fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.653279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0324883-5328-44ee-b21e-37ed25c8fbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.653730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0324883-5328-44ee-b21e-37ed25c8fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.654181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0324883-5328-44ee-b21e-37ed25c8fbf9 admin admin] PATH_INFO: `/v3/projects/a5eb238030ef42ce9211c9be536a4c2b/users/8f0b36aadeee4680bd881fd49e141ba3/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.662116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-9c54cd8f-fdd6-46fe-94b9-e489d0fc8d14 None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:17.664134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9c54cd8f-fdd6-46fe-94b9-e489d0fc8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:17.681225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0324883-5328-44ee-b21e-37ed25c8fbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5eb238030ef42ce9211c9be536a4c2b, user_id=8f0b36aadeee4680bd881fd49e141ba3, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.685316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0324883-5328-44ee-b21e-37ed25c8fbf9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:17.741646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 805/1623] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:17 2022] PUT /identity/v3/projects/a5eb238030ef42ce9211c9be536a4c2b/users/8f0b36aadeee4680bd881fd49e141ba3/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:17.743790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0324883-5328-44ee-b21e-37ed25c8fbf9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.901340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 819/1624] 10.222.0.72 () {58 vars in 1058 bytes} [Tue Jul 12 14:33:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:17.902550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54cd8f-fdd6-46fe-94b9-e489d0fc8d14 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:17.916644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54cd8f-fdd6-46fe-94b9-e489d0fc8d14 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.935848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:17.943966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0324883-5328-44ee-b21e-37ed25c8fbf9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:17.960676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2750c-c61e-4a94-a15b-1f37995cae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:17.961391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2750c-c61e-4a94-a15b-1f37995cae7f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.961684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2750c-c61e-4a94-a15b-1f37995cae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.961967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2750c-c61e-4a94-a15b-1f37995cae7f admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.962766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2750c-c61e-4a94-a15b-1f37995cae7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:17.964652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2750c-c61e-4a94-a15b-1f37995cae7f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.004661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 806/1625] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:17 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:18.005416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2750c-c61e-4a94-a15b-1f37995cae7f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.013647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42df8c-b62d-437c-9c3c-12eb51ca0330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.013952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42df8c-b62d-437c-9c3c-12eb51ca0330 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.014274 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42df8c-b62d-437c-9c3c-12eb51ca0330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.014566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42df8c-b62d-437c-9c3c-12eb51ca0330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.015652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42df8c-b62d-437c-9c3c-12eb51ca0330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.018642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42df8c-b62d-437c-9c3c-12eb51ca0330 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.024427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2750c-c61e-4a94-a15b-1f37995cae7f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.039969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d95bf-1209-46a0-81ec-810e75dfa574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.040666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d95bf-1209-46a0-81ec-810e75dfa574 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.040960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d95bf-1209-46a0-81ec-810e75dfa574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.041244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d95bf-1209-46a0-81ec-810e75dfa574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.041351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 820/1626] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:18.041988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d95bf-1209-46a0-81ec-810e75dfa574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.042465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42df8c-b62d-437c-9c3c-12eb51ca0330 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.046883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d95bf-1209-46a0-81ec-810e75dfa574 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.070611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 807/1627] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:18.071799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d95bf-1209-46a0-81ec-810e75dfa574 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.085966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d95bf-1209-46a0-81ec-810e75dfa574 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.092107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4813e-ff12-4327-90cb-fad890b67055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.093069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4813e-ff12-4327-90cb-fad890b67055 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.093577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4813e-ff12-4327-90cb-fad890b67055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.094222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4813e-ff12-4327-90cb-fad890b67055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.095321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4813e-ff12-4327-90cb-fad890b67055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.097192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4813e-ff12-4327-90cb-fad890b67055 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.106847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:18.114161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 808/1628] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:18.115551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4813e-ff12-4327-90cb-fad890b67055 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.133578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4813e-ff12-4327-90cb-fad890b67055 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.141247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c34d-fdc8-4f10-b321-333866cf6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.143313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c34d-fdc8-4f10-b321-333866cf6af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.143964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c34d-fdc8-4f10-b321-333866cf6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.144521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c34d-fdc8-4f10-b321-333866cf6af6 admin admin] PATH_INFO: `/v3/projects/9d479457ebdc4acfb79056a9787ca9b6/users/8e0513a3b6794c91aa17caad80ae57d9/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.176983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c34d-fdc8-4f10-b321-333866cf6af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d479457ebdc4acfb79056a9787ca9b6, user_id=8e0513a3b6794c91aa17caad80ae57d9, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.179849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c34d-fdc8-4f10-b321-333866cf6af6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.212466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42df8c-b62d-437c-9c3c-12eb51ca0330 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.213987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 809/1629] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:18 2022] PUT /identity/v3/projects/9d479457ebdc4acfb79056a9787ca9b6/users/8e0513a3b6794c91aa17caad80ae57d9/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:18.217686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c34d-fdc8-4f10-b321-333866cf6af6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.328583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acfd2-ea76-4580-8b4d-2616421a20f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.340767 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acfd2-ea76-4580-8b4d-2616421a20f5 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.341436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acfd2-ea76-4580-8b4d-2616421a20f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.341795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6acfd2-ea76-4580-8b4d-2616421a20f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.365017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c34d-fdc8-4f10-b321-333866cf6af6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.399111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed447e-42e4-4119-bc53-fca77066cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.400804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed447e-42e4-4119-bc53-fca77066cc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.401225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed447e-42e4-4119-bc53-fca77066cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.401695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed447e-42e4-4119-bc53-fca77066cc55 admin admin] PATH_INFO: `/v3/projects/a5eb238030ef42ce9211c9be536a4c2b/users/8f0b36aadeee4680bd881fd49e141ba3/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.410158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed447e-42e4-4119-bc53-fca77066cc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5eb238030ef42ce9211c9be536a4c2b, user_id=8f0b36aadeee4680bd881fd49e141ba3, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.420424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed447e-42e4-4119-bc53-fca77066cc55 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.459890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 810/1630] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:18 2022] PUT /identity/v3/projects/a5eb238030ef42ce9211c9be536a4c2b/users/8f0b36aadeee4680bd881fd49e141ba3/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:18.459890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed447e-42e4-4119-bc53-fca77066cc55 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.460203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:18.468424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6acfd2-ea76-4580-8b4d-2616421a20f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.470805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6acfd2-ea76-4580-8b4d-2616421a20f5 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.486363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 821/1631] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:18.487944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acfd2-ea76-4580-8b4d-2616421a20f5 service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.508809 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6acfd2-ea76-4580-8b4d-2616421a20f5 service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.579674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed447e-42e4-4119-bc53-fca77066cc55 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.593805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421490-c58b-4635-887d-269a0ae98dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.596834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421490-c58b-4635-887d-269a0ae98dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.597128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421490-c58b-4635-887d-269a0ae98dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.599291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421490-c58b-4635-887d-269a0ae98dda admin admin] PATH_INFO: `/v3/projects/f74ccb5d945841ef9e7289028706e693/users/8f850504dc964682a73194559c07b827/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.640328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5aeaf-c9e7-44f1-a011-18e56b993774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.642414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5aeaf-c9e7-44f1-a011-18e56b993774 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.643017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5aeaf-c9e7-44f1-a011-18e56b993774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.643344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00421490-c58b-4635-887d-269a0ae98dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74ccb5d945841ef9e7289028706e693, user_id=8f850504dc964682a73194559c07b827, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.643852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5aeaf-c9e7-44f1-a011-18e56b993774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.644748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5aeaf-c9e7-44f1-a011-18e56b993774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.646518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5aeaf-c9e7-44f1-a011-18e56b993774 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.650479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00421490-c58b-4635-887d-269a0ae98dda admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.660275 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 822/1632] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:18.666549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a01d-2358-4571-b407-0ac1270bc067 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.667030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a01d-2358-4571-b407-0ac1270bc067 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.667450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a01d-2358-4571-b407-0ac1270bc067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.683096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 811/1633] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:18 2022] PUT /identity/v3/projects/f74ccb5d945841ef9e7289028706e693/users/8f850504dc964682a73194559c07b827/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:18.684481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421490-c58b-4635-887d-269a0ae98dda admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.719087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7be7a01d-2358-4571-b407-0ac1270bc067 None None] MFA Rules not processed for user `8f0b36aadeee4680bd881fd49e141ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:18.723161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7be7a01d-2358-4571-b407-0ac1270bc067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:18.800714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:18.832793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421490-c58b-4635-887d-269a0ae98dda admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.835380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 823/1634] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:18.836712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a01d-2358-4571-b407-0ac1270bc067 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.843571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d99364-51b4-4a28-9629-4fe7fe1c0e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.847495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d99364-51b4-4a28-9629-4fe7fe1c0e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.847784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d99364-51b4-4a28-9629-4fe7fe1c0e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.848065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d99364-51b4-4a28-9629-4fe7fe1c0e99 admin admin] PATH_INFO: `/v3/projects/9d479457ebdc4acfb79056a9787ca9b6/users/8e0513a3b6794c91aa17caad80ae57d9/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.852372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d99364-51b4-4a28-9629-4fe7fe1c0e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d479457ebdc4acfb79056a9787ca9b6, user_id=8e0513a3b6794c91aa17caad80ae57d9, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:18.854120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d99364-51b4-4a28-9629-4fe7fe1c0e99 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:18.856281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a01d-2358-4571-b407-0ac1270bc067 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.879229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 812/1635] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:18 2022] PUT /identity/v3/projects/9d479457ebdc4acfb79056a9787ca9b6/users/8e0513a3b6794c91aa17caad80ae57d9/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:18.880393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d99364-51b4-4a28-9629-4fe7fe1c0e99 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:18.991058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d99364-51b4-4a28-9629-4fe7fe1c0e99 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:18.996681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08668e-8a5e-4947-8520-76004adaac2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:18.997182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08668e-8a5e-4947-8520-76004adaac2b service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.997588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08668e-8a5e-4947-8520-76004adaac2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.998555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08668e-8a5e-4947-8520-76004adaac2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.066421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6bbd1-cf16-4a32-9c69-33886dda2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:19.067711 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bbd1-cf16-4a32-9c69-33886dda2457 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:19.070536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bbd1-cf16-4a32-9c69-33886dda2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:19.070867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6bbd1-cf16-4a32-9c69-33886dda2457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.071641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6bbd1-cf16-4a32-9c69-33886dda2457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:19.073293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6bbd1-cf16-4a32-9c69-33886dda2457 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:19.130046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 824/1636] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:19.130046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb056f-425b-4955-89ee-85c591486954 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:19.132929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb056f-425b-4955-89ee-85c591486954 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:19.133352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb056f-425b-4955-89ee-85c591486954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.134390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08668e-8a5e-4947-8520-76004adaac2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:19.135899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08668e-8a5e-4947-8520-76004adaac2b service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:19.147422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:19.156479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 813/1637] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:19.159401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73717ee-e7ec-470a-a7db-844f46bfbd52 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:19.159711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73717ee-e7ec-470a-a7db-844f46bfbd52 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:19.159996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73717ee-e7ec-470a-a7db-844f46bfbd52 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.166038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 814/1638] 10.222.0.72 () {54 vars in 912 bytes} [Tue Jul 12 14:33:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:19.166915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73717ee-e7ec-470a-a7db-844f46bfbd52 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:19.182968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f1cb056f-425b-4955-89ee-85c591486954 None None] MFA Rules not processed for user `8e0513a3b6794c91aa17caad80ae57d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:19.184398 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f1cb056f-425b-4955-89ee-85c591486954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:19.200724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73717ee-e7ec-470a-a7db-844f46bfbd52 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:19.214329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5cbaa-7365-4cec-ae0b-b355483fc9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:19.215296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5cbaa-7365-4cec-ae0b-b355483fc9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:19.215587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5cbaa-7365-4cec-ae0b-b355483fc9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:19.216019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5cbaa-7365-4cec-ae0b-b355483fc9f4 admin admin] PATH_INFO: `/v3/projects/f74ccb5d945841ef9e7289028706e693/users/8f850504dc964682a73194559c07b827/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.219713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5cbaa-7365-4cec-ae0b-b355483fc9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74ccb5d945841ef9e7289028706e693, user_id=8f850504dc964682a73194559c07b827, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:19.225590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5cbaa-7365-4cec-ae0b-b355483fc9f4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:19.269311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 815/1639] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:19 2022] PUT /identity/v3/projects/f74ccb5d945841ef9e7289028706e693/users/8f850504dc964682a73194559c07b827/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:19.269311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0777bb-721d-4b50-b4b4-5cddbe3f6f06 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:19.269311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0777bb-721d-4b50-b4b4-5cddbe3f6f06 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:19.269311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0777bb-721d-4b50-b4b4-5cddbe3f6f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.330507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ca0777bb-721d-4b50-b4b4-5cddbe3f6f06 None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:19.331995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ca0777bb-721d-4b50-b4b4-5cddbe3f6f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:19.387107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 825/1640] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:19.388432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d8b33-e573-4572-b05f-95725f713fff None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:19.388829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d8b33-e573-4572-b05f-95725f713fff None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:19.389214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d8b33-e573-4572-b05f-95725f713fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.484661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-032d8b33-e573-4572-b05f-95725f713fff None None] MFA Rules not processed for user `8f850504dc964682a73194559c07b827`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:19.488416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-032d8b33-e573-4572-b05f-95725f713fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:19.514034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 816/1641] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:19.515573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0777bb-721d-4b50-b4b4-5cddbe3f6f06 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:19.539151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:19.622995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0777bb-721d-4b50-b4b4-5cddbe3f6f06 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:19.630950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178545-df23-49a0-9343-dea594627dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:19.634177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178545-df23-49a0-9343-dea594627dbe service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:19.634437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178545-df23-49a0-9343-dea594627dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:19.634876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178545-df23-49a0-9343-dea594627dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.638967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 826/1642] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:19.640171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d8b33-e573-4572-b05f-95725f713fff None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:19.665928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d8b33-e573-4572-b05f-95725f713fff None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:19.674968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e77ec-9095-4d6e-b36d-402a9bacb702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:19.678047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e77ec-9095-4d6e-b36d-402a9bacb702 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:19.678471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e77ec-9095-4d6e-b36d-402a9bacb702 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:19.678904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e77ec-9095-4d6e-b36d-402a9bacb702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:19.727954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b178545-df23-49a0-9343-dea594627dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:19.729937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b178545-df23-49a0-9343-dea594627dbe service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:19.761918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 817/1643] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:19.853683 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e77ec-9095-4d6e-b36d-402a9bacb702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:19.855546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e77ec-9095-4d6e-b36d-402a9bacb702 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:19.873177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 827/1644] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:20.707935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178545-df23-49a0-9343-dea594627dbe service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:20.718213 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178545-df23-49a0-9343-dea594627dbe service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:20.729633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb4ec8-1f0c-44d2-8dba-97b6f713ce60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:20.730434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4ec8-1f0c-44d2-8dba-97b6f713ce60 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:20.730858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4ec8-1f0c-44d2-8dba-97b6f713ce60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:20.731245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4ec8-1f0c-44d2-8dba-97b6f713ce60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:20.780931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e77ec-9095-4d6e-b36d-402a9bacb702 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:20.792535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e77ec-9095-4d6e-b36d-402a9bacb702 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:20.796093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb4ec8-1f0c-44d2-8dba-97b6f713ce60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:20.800348 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb4ec8-1f0c-44d2-8dba-97b6f713ce60 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:20.803311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e0315-1389-41b2-a8e4-b4ebfef1a534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:20.804077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0315-1389-41b2-a8e4-b4ebfef1a534 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:20.804429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0315-1389-41b2-a8e4-b4ebfef1a534 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:20.804690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0315-1389-41b2-a8e4-b4ebfef1a534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:20.834929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e0315-1389-41b2-a8e4-b4ebfef1a534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:20.837818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e0315-1389-41b2-a8e4-b4ebfef1a534 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:20.844440 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:20.855268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 828/1645] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:20.881841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 818/1646] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:21.499125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e0315-1389-41b2-a8e4-b4ebfef1a534 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:21.514518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e0315-1389-41b2-a8e4-b4ebfef1a534 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:21.535541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75b90-2a21-4698-aa6f-e577d4cbb91b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:21.536230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75b90-2a21-4698-aa6f-e577d4cbb91b service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:21.536699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75b90-2a21-4698-aa6f-e577d4cbb91b service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:21.536806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75b90-2a21-4698-aa6f-e577d4cbb91b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:21.753174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75b90-2a21-4698-aa6f-e577d4cbb91b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:21.754913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75b90-2a21-4698-aa6f-e577d4cbb91b service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:21.769208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 829/1647] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:22.397932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d331bdf-491c-41a2-856b-7d55864dd217 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.398658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d331bdf-491c-41a2-856b-7d55864dd217 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.398795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d331bdf-491c-41a2-856b-7d55864dd217 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:22.400427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 819/1648] 10.222.0.72 () {54 vars in 961 bytes} [Tue Jul 12 14:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:22.417900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8d9-c00e-4e29-9b02-7efb00805334 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.418510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8d9-c00e-4e29-9b02-7efb00805334 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.419798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcc8d9-c00e-4e29-9b02-7efb00805334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:22.461098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e4fcc8d9-c00e-4e29-9b02-7efb00805334 None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:22.465207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e4fcc8d9-c00e-4e29-9b02-7efb00805334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:22.507498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 830/1649] 10.222.0.72 () {58 vars in 1058 bytes} [Tue Jul 12 14:33:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:22.514446 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1717-4e7a-42ef-a01e-e1f740035848 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.514739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1717-4e7a-42ef-a01e-e1f740035848 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.515059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1717-4e7a-42ef-a01e-e1f740035848 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:22.517814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 820/1650] 10.222.0.72 () {54 vars in 912 bytes} [Tue Jul 12 14:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:22.523723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d44e7-0961-426c-af09-c91f25a5ef63 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.524257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d44e7-0961-426c-af09-c91f25a5ef63 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.524729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d44e7-0961-426c-af09-c91f25a5ef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:22.567888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-310d44e7-0961-426c-af09-c91f25a5ef63 None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:22.571539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-310d44e7-0961-426c-af09-c91f25a5ef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:22.621117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 831/1651] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:33:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:22.635627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae1717-4e7a-42ef-a01e-e1f740035848 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:22.659556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae1717-4e7a-42ef-a01e-e1f740035848 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:22.672825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4622e-dedf-4598-b5c8-b98b34a00a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:22.673686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4622e-dedf-4598-b5c8-b98b34a00a00 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.674121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4622e-dedf-4598-b5c8-b98b34a00a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.674523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4622e-dedf-4598-b5c8-b98b34a00a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:22.710343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4622e-dedf-4598-b5c8-b98b34a00a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:22.712363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4622e-dedf-4598-b5c8-b98b34a00a00 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:22.745023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 821/1652] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:23.662188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d44e7-0961-426c-af09-c91f25a5ef63 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:23.679908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d44e7-0961-426c-af09-c91f25a5ef63 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:23.692176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d32408-dbe4-4d8c-8451-c225d0c8ce25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:23.692926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d32408-dbe4-4d8c-8451-c225d0c8ce25 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:23.693214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d32408-dbe4-4d8c-8451-c225d0c8ce25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:23.693554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d32408-dbe4-4d8c-8451-c225d0c8ce25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:23.858244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d32408-dbe4-4d8c-8451-c225d0c8ce25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:23.859904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d32408-dbe4-4d8c-8451-c225d0c8ce25 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:23.896191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 832/1653] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:25.828273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b30cb-8178-4880-9841-9e07392602dd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:25.829347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b30cb-8178-4880-9841-9e07392602dd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:25.829916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b30cb-8178-4880-9841-9e07392602dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:25.915441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-955b30cb-8178-4880-9841-9e07392602dd None None] MFA Rules not processed for user `27cbfa54860940bc84e576943c0b9503`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:25.917048 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-955b30cb-8178-4880-9841-9e07392602dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:25.992593 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d32408-dbe4-4d8c-8451-c225d0c8ce25 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:26.196743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 822/1654] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:26.204384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f6da4-f9a6-486e-b4a2-d85e62089590 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:26.204475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f6da4-f9a6-486e-b4a2-d85e62089590 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:26.206472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f6da4-f9a6-486e-b4a2-d85e62089590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:26.231382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d32408-dbe4-4d8c-8451-c225d0c8ce25 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:26.253772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:26.254876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:26.255146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:26.255518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] PATH_INFO: `/v3/users/f7d1211692ff4672ad74c31a5780b37f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:26.262903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d1211692ff4672ad74c31a5780b37f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:26.262903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:26.270585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b22f6da4-f9a6-486e-b4a2-d85e62089590 None None] MFA Rules not processed for user `27cbfa54860940bc84e576943c0b9503`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:26.279300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b22f6da4-f9a6-486e-b4a2-d85e62089590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:26.308253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 823/1655] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:26.317534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f6da4-f9a6-486e-b4a2-d85e62089590 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:26.346352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:26.361752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f6da4-f9a6-486e-b4a2-d85e62089590 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:26.392316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e28c5-f4b7-42d5-b8bb-0a4e05dcff49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:26.393007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e28c5-f4b7-42d5-b8bb-0a4e05dcff49 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:26.393299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e28c5-f4b7-42d5-b8bb-0a4e05dcff49 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:26.393585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e28c5-f4b7-42d5-b8bb-0a4e05dcff49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:26.413822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d1211692ff4672ad74c31a5780b37f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:26.426252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e28c5-f4b7-42d5-b8bb-0a4e05dcff49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:26.427935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e28c5-f4b7-42d5-b8bb-0a4e05dcff49 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:26.446686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d1211692ff4672ad74c31a5780b37f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:26.450759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d1211692ff4672ad74c31a5780b37f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:26.475232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 824/1656] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:26.481287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d1211692ff4672ad74c31a5780b37f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:26.491777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d1211692ff4672ad74c31a5780b37f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:26.511709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 833/1657] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:25 2022] DELETE /identity/v3/users/f7d1211692ff4672ad74c31a5780b37f => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:33:26.513274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacff10-f73c-44d4-ba85-620b05a4caca None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:26.513584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacff10-f73c-44d4-ba85-620b05a4caca None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:26.513877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacff10-f73c-44d4-ba85-620b05a4caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:26.569648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-edacff10-f73c-44d4-ba85-620b05a4caca None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:26.574747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-edacff10-f73c-44d4-ba85-620b05a4caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:26.610702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:26.809069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 825/1658] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:27.011145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:27.015521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:27.198895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac625c-475c-45d1-a56c-35ef78acf0f4 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:27.209727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1e99-4908-4a59-b550-78d2f97839c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:27.210594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1e99-4908-4a59-b550-78d2f97839c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:27.210936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1e99-4908-4a59-b550-78d2f97839c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:27.211396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1e99-4908-4a59-b550-78d2f97839c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:27.241421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1e99-4908-4a59-b550-78d2f97839c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:27.245858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1e99-4908-4a59-b550-78d2f97839c0 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:27.284017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 834/1659] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:28.098326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacff10-f73c-44d4-ba85-620b05a4caca None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:28.099808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-edacff10-f73c-44d4-ba85-620b05a4caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:28.113468 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacff10-f73c-44d4-ba85-620b05a4caca None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:28.125714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:28.126642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:28.129282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:28.129616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] PATH_INFO: `/v3/users/59284686eacc4f47a8ab483665157c6b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:28.135359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=59284686eacc4f47a8ab483665157c6b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:28.139836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: WARNING py.warnings [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:33:28.139836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: warnings.warn(msg) Jul 12 14:33:28.139836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: Jul 12 14:33:28.141559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:28.311473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1390-e00e-4bcb-8f70-aa225583069b None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:28.312618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1390-e00e-4bcb-8f70-aa225583069b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:28.313242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1390-e00e-4bcb-8f70-aa225583069b None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:28.316121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 835/1660] 10.222.0.72 () {54 vars in 912 bytes} [Tue Jul 12 14:33:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:28.323911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711af7c-f8f9-460d-85b8-9fef3d867f0a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:28.324549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711af7c-f8f9-460d-85b8-9fef3d867f0a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:28.325105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711af7c-f8f9-460d-85b8-9fef3d867f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:28.392342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59284686eacc4f47a8ab483665157c6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:28.394745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59284686eacc4f47a8ab483665157c6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:28.399020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-3711af7c-f8f9-460d-85b8-9fef3d867f0a None None] MFA Rules not processed for user `18d55b1fd69640548e7b35258e33e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:28.400860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3711af7c-f8f9-460d-85b8-9fef3d867f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:28.417164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 836/1661] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:28.420351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59284686eacc4f47a8ab483665157c6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:28.449487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711af7c-f8f9-460d-85b8-9fef3d867f0a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:28.455699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59284686eacc4f47a8ab483665157c6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:28.458412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3711af7c-f8f9-460d-85b8-9fef3d867f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:28.487318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711af7c-f8f9-460d-85b8-9fef3d867f0a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:28.493951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e31dac-dc0d-4aa0-b3a4-240fe848c007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:28.495151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e31dac-dc0d-4aa0-b3a4-240fe848c007 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:28.495703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e31dac-dc0d-4aa0-b3a4-240fe848c007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:28.496363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e31dac-dc0d-4aa0-b3a4-240fe848c007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:28.510526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e31dac-dc0d-4aa0-b3a4-240fe848c007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:28.514576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e31dac-dc0d-4aa0-b3a4-240fe848c007 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:28.518854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59284686eacc4f47a8ab483665157c6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:28.528308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 837/1662] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:28.542665 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 826/1663] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:28 2022] DELETE /identity/v3/users/59284686eacc4f47a8ab483665157c6b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:28.546736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95936d39-8bc4-42e1-b41d-e57d429b320c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:28.548554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95936d39-8bc4-42e1-b41d-e57d429b320c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:28.549276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95936d39-8bc4-42e1-b41d-e57d429b320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:28.592846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-95936d39-8bc4-42e1-b41d-e57d429b320c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:28.594486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-95936d39-8bc4-42e1-b41d-e57d429b320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:28.695281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 838/1664] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:28.710123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:28.818262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7646b-d3d1-44df-ae71-9d42a63752bb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:28.822821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:28.824161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:28.824161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:28.824361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:28.836482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:28.839942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:28.870642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 827/1665] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:29.364415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95936d39-8bc4-42e1-b41d-e57d429b320c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:29.368429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:29.369955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:29.373526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-95936d39-8bc4-42e1-b41d-e57d429b320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:29.399101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63d025-808d-471c-9840-e80c866c73be service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:29.412564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95936d39-8bc4-42e1-b41d-e57d429b320c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:29.419314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:29.420231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.420521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.420803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] PATH_INFO: `/v3/projects/f72b6318e4224f2398bcb2e6196d1646` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.424770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72b6318e4224f2398bcb2e6196d1646)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:29.425912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:29.429745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:29.432884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.432884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.432884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] PATH_INFO: `/v3/users/4adff04fdbea4d9c9eccda6538974d62` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.436060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4adff04fdbea4d9c9eccda6538974d62)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:29.443017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:29.453130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:29.512012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:29.561398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72b6318e4224f2398bcb2e6196d1646', 'request_id': 'req-8fae77c8-e40e-44df-b47a-7b8142606768'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.575178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72b6318e4224f2398bcb2e6196d1646', 'request_id': 'req-8fae77c8-e40e-44df-b47a-7b8142606768'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.580502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4adff04fdbea4d9c9eccda6538974d62'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.593390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72b6318e4224f2398bcb2e6196d1646', 'request_id': 'req-8fae77c8-e40e-44df-b47a-7b8142606768'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.612998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4adff04fdbea4d9c9eccda6538974d62'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.613740 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4adff04fdbea4d9c9eccda6538974d62'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.619143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] The token cache is being invalidate because project f72b6318e4224f2398bcb2e6196d1646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:29.619437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.623214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.625278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 828/1666] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:29 2022] DELETE /identity/v3/projects/f72b6318e4224f2398bcb2e6196d1646 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:29.629538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:29.631521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:29.634847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4adff04fdbea4d9c9eccda6538974d62'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.647294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f726c524-b77b-4e99-a104-16c645713203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4adff04fdbea4d9c9eccda6538974d62'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:29.659551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 839/1667] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:29 2022] DELETE /identity/v3/users/4adff04fdbea4d9c9eccda6538974d62 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:29.661735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1057-b07d-49bf-a896-f1958b3bfeee None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.662184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1057-b07d-49bf-a896-f1958b3bfeee None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.662729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1057-b07d-49bf-a896-f1958b3bfeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.691084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5a3c1057-b07d-49bf-a896-f1958b3bfeee None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:29.694106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5a3c1057-b07d-49bf-a896-f1958b3bfeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:29.799157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae77c8-e40e-44df-b47a-7b8142606768 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:29.890045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 840/1668] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:29.891281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e588f64-fcec-4233-bb7a-71b82952bdc7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.891574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e588f64-fcec-4233-bb7a-71b82952bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.895080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e588f64-fcec-4233-bb7a-71b82952bdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.904754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:29.905670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.905961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.906246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] PATH_INFO: `/v3/users/8f0b36aadeee4680bd881fd49e141ba3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.908994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0b36aadeee4680bd881fd49e141ba3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:29.910993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:29.944872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5e588f64-fcec-4233-bb7a-71b82952bdc7 None None] MFA Rules not processed for user `3522c9dae7854c2395b6a00a9094b10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:29.946483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5e588f64-fcec-4233-bb7a-71b82952bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:30.052100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0b36aadeee4680bd881fd49e141ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:30.055455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0b36aadeee4680bd881fd49e141ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:30.092569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0b36aadeee4680bd881fd49e141ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:30.105231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:30.127794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 841/1669] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:30.131826 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0b36aadeee4680bd881fd49e141ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:30.135054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6dc45-0e34-4e37-b8c2-8d02ecfa06d5 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:30.135401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6dc45-0e34-4e37-b8c2-8d02ecfa06d5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:30.135689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6dc45-0e34-4e37-b8c2-8d02ecfa06d5 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:30.143329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 842/1670] 10.222.0.72 () {54 vars in 960 bytes} [Tue Jul 12 14:33:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:30.147411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6dc45-0e34-4e37-b8c2-8d02ecfa06d5 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:30.152917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-75b6dc45-0e34-4e37-b8c2-8d02ecfa06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:30.177794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c3a72de0-d742-4460-aeff-bbf91dd844c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0b36aadeee4680bd881fd49e141ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:30.189564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:30.198420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 829/1671] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:29 2022] DELETE /identity/v3/users/8f0b36aadeee4680bd881fd49e141ba3 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:33:30.200598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3076-66a6-4976-bfd0-9e3780c1ce41 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:30.200907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3076-66a6-4976-bfd0-9e3780c1ce41 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:30.201194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3076-66a6-4976-bfd0-9e3780c1ce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:30.250608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b31c3076-66a6-4976-bfd0-9e3780c1ce41 None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:30.252173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b31c3076-66a6-4976-bfd0-9e3780c1ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:30.333780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6dc45-0e34-4e37-b8c2-8d02ecfa06d5 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:30.423030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 830/1672] 10.222.0.72 () {58 vars in 1057 bytes} [Tue Jul 12 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:30.426095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3076-66a6-4976-bfd0-9e3780c1ce41 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:30.433240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b31c3076-66a6-4976-bfd0-9e3780c1ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:30.441723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72698eaa-c971-4d4c-9dcb-9b3f28d5e9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:30.445837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698eaa-c971-4d4c-9dcb-9b3f28d5e9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:30.446203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698eaa-c971-4d4c-9dcb-9b3f28d5e9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:30.446478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698eaa-c971-4d4c-9dcb-9b3f28d5e9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:30.456401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-72698eaa-c971-4d4c-9dcb-9b3f28d5e9c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:30.668719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3076-66a6-4976-bfd0-9e3780c1ce41 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:30.680089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba9919-ce1e-4f02-8883-8eb85fc11a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:30.680825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba9919-ce1e-4f02-8883-8eb85fc11a7b service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:30.681045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba9919-ce1e-4f02-8883-8eb85fc11a7b service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:30.681620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba9919-ce1e-4f02-8883-8eb85fc11a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:30.691624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72698eaa-c971-4d4c-9dcb-9b3f28d5e9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:30.694311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72698eaa-c971-4d4c-9dcb-9b3f28d5e9c0 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:30.718389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 843/1673] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:30.720004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d66fb-3b33-4493-a956-87155bc38d10 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:30.720304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d66fb-3b33-4493-a956-87155bc38d10 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:30.720764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d66fb-3b33-4493-a956-87155bc38d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:30.744682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-505d66fb-3b33-4493-a956-87155bc38d10 None None] MFA Rules not processed for user `27cbfa54860940bc84e576943c0b9503`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:30.748261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-505d66fb-3b33-4493-a956-87155bc38d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:30.833188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba9919-ce1e-4f02-8883-8eb85fc11a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:30.835698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba9919-ce1e-4f02-8883-8eb85fc11a7b service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:30.850031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 831/1674] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:30.850927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba9919-ce1e-4f02-8883-8eb85fc11a7b service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:30.881631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba9919-ce1e-4f02-8883-8eb85fc11a7b service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:30.889355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616ad4d-49d4-4f50-ba4c-12eee63975c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:30.890280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616ad4d-49d4-4f50-ba4c-12eee63975c2 service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:30.892022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616ad4d-49d4-4f50-ba4c-12eee63975c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:30.892662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616ad4d-49d4-4f50-ba4c-12eee63975c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:30.906330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c616ad4d-49d4-4f50-ba4c-12eee63975c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:30.919272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 844/1675] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:30.920305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d66fb-3b33-4493-a956-87155bc38d10 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:30.929001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-505d66fb-3b33-4493-a956-87155bc38d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:30.938664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616ad4d-49d4-4f50-ba4c-12eee63975c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:30.940790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616ad4d-49d4-4f50-ba4c-12eee63975c2 service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:30.948291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:30.972817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 832/1676] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:30.980208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d66fb-3b33-4493-a956-87155bc38d10 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:31.027914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:31.027914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.027914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.027914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] PATH_INFO: `/v3/projects/aa015fea356346faa8efed67ace71e4e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.028258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa015fea356346faa8efed67ace71e4e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:31.028258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: WARNING py.warnings [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:33:31.028258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: warnings.warn(msg) Jul 12 14:33:31.028258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: Jul 12 14:33:31.028850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:31.095306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:31.177709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa015fea356346faa8efed67ace71e4e', 'request_id': 'req-f38623f1-7f0a-4229-91b6-d4793c3df91e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:31.196360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa015fea356346faa8efed67ace71e4e', 'request_id': 'req-f38623f1-7f0a-4229-91b6-d4793c3df91e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:31.220477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa015fea356346faa8efed67ace71e4e', 'request_id': 'req-f38623f1-7f0a-4229-91b6-d4793c3df91e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:31.243861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] The token cache is being invalidate because project aa015fea356346faa8efed67ace71e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:31.244533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:31.246150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f38623f1-7f0a-4229-91b6-d4793c3df91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:31.249802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 845/1677] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:30 2022] DELETE /identity/v3/projects/aa015fea356346faa8efed67ace71e4e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:31.255287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a12a-fa9f-4dea-a7c2-872b427575fb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.256065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a12a-fa9f-4dea-a7c2-872b427575fb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.256564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a12a-fa9f-4dea-a7c2-872b427575fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.287395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b558a12a-fa9f-4dea-a7c2-872b427575fb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:31.289308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b558a12a-fa9f-4dea-a7c2-872b427575fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:31.386818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 833/1678] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:31.390659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b756a9f-08ac-4e37-8827-15b8d2a3272a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.391546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b756a9f-08ac-4e37-8827-15b8d2a3272a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.392043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b756a9f-08ac-4e37-8827-15b8d2a3272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.420822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-9b756a9f-08ac-4e37-8827-15b8d2a3272a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:31.422541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9b756a9f-08ac-4e37-8827-15b8d2a3272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:31.437959 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 846/1679] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:31.440328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558a12a-fa9f-4dea-a7c2-872b427575fb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:31.466018 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558a12a-fa9f-4dea-a7c2-872b427575fb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:31.474657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:31.476089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.476454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.476788 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.477561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:31.477878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:31.481606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:31.501261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 834/1680] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:31.502578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b756a9f-08ac-4e37-8827-15b8d2a3272a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:31.520391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b756a9f-08ac-4e37-8827-15b8d2a3272a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:31.535699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:31.536397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.539585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.539896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.540649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:31.546524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:31.617351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 847/1681] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:31 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:31.621112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:31.641399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc7a6-6a47-473f-bae3-4d7cb4455cab admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:31.700480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:31.708880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:31.877374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0ae65-3b03-4c26-ae81-9bdf45e3db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:31.878506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ae65-3b03-4c26-ae81-9bdf45e3db44 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.878816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ae65-3b03-4c26-ae81-9bdf45e3db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.879103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ae65-3b03-4c26-ae81-9bdf45e3db44 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.880044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0ae65-3b03-4c26-ae81-9bdf45e3db44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:31.885033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0ae65-3b03-4c26-ae81-9bdf45e3db44 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:31.916825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dad2d8-809e-4252-9f2b-5805b7d0c650 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:31.934269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 835/1682] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:31 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:31.936325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:31.937069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.937700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a82ec-9d2c-44e1-a103-4153e2b3fee8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.938443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a82ec-9d2c-44e1-a103-4153e2b3fee8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.938545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a82ec-9d2c-44e1-a103-4153e2b3fee8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.939433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.939726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] PATH_INFO: `/v3/projects/a5eb238030ef42ce9211c9be536a4c2b` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.951771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5eb238030ef42ce9211c9be536a4c2b)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:31.953042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 836/1683] 10.222.0.72 () {54 vars in 912 bytes} [Tue Jul 12 14:33:31 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:31.956694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:31.957346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16353f-761e-4c35-abc0-79d6d016ac7e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.958036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16353f-761e-4c35-abc0-79d6d016ac7e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.959217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16353f-761e-4c35-abc0-79d6d016ac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.015222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-aa16353f-761e-4c35-abc0-79d6d016ac7e None None] MFA Rules not processed for user `a0794c7a4d5e416caccfa3bd6ce5ea17`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:32.017781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-aa16353f-761e-4c35-abc0-79d6d016ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.075985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5eb238030ef42ce9211c9be536a4c2b', 'request_id': 'req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.095496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5eb238030ef42ce9211c9be536a4c2b', 'request_id': 'req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.106820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5eb238030ef42ce9211c9be536a4c2b', 'request_id': 'req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.136792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] The token cache is being invalidate because project a5eb238030ef42ce9211c9be536a4c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:32.137087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.137872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.144658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 848/1684] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:31 2022] DELETE /identity/v3/projects/a5eb238030ef42ce9211c9be536a4c2b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:33:32.144658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:32.145227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.164588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:32.220271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 837/1685] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:32.225073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118e126-b924-4178-a7d3-469bc40dc694 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.225432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118e126-b924-4178-a7d3-469bc40dc694 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.225903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118e126-b924-4178-a7d3-469bc40dc694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.242163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:32.270805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e118e126-b924-4178-a7d3-469bc40dc694 None None] MFA Rules not processed for user `18d55b1fd69640548e7b35258e33e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:32.275723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e118e126-b924-4178-a7d3-469bc40dc694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.318200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15ae4-c7fe-41a8-9b55-061ba38f88b3 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:32.332862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:32.333575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.333861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.334137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.334911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:32.338892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:32.367210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 849/1686] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:32.371615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:32.374939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.407819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f2dbb-c368-4965-9d36-e66b5a4de673 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:32.418993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 838/1687] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:32.420714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b06b-d3be-4a81-b6d3-619b794d1776 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.424668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b06b-d3be-4a81-b6d3-619b794d1776 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.426409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b06b-d3be-4a81-b6d3-619b794d1776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.435402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:32.436562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.436951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.437335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] PATH_INFO: `/v3/projects/361ecfe3ee4b4ed1855d741f57f00ba5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.439579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361ecfe3ee4b4ed1855d741f57f00ba5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:32.445754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:32.529149 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1a79b06b-d3be-4a81-b6d3-619b794d1776 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:32.530516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1a79b06b-d3be-4a81-b6d3-619b794d1776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.590034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361ecfe3ee4b4ed1855d741f57f00ba5', 'request_id': 'req-9f85a619-bff9-4976-8602-a4900de37676'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.617000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361ecfe3ee4b4ed1855d741f57f00ba5', 'request_id': 'req-9f85a619-bff9-4976-8602-a4900de37676'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.640226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361ecfe3ee4b4ed1855d741f57f00ba5', 'request_id': 'req-9f85a619-bff9-4976-8602-a4900de37676'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.675509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] The token cache is being invalidate because project 361ecfe3ee4b4ed1855d741f57f00ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:32.675798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.680777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f85a619-bff9-4976-8602-a4900de37676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:32.685739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 850/1688] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:32 2022] DELETE /identity/v3/projects/361ecfe3ee4b4ed1855d741f57f00ba5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:32.687583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5059-21bd-4e02-9e98-22bb3b3b1336 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.687919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5059-21bd-4e02-9e98-22bb3b3b1336 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.688205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5059-21bd-4e02-9e98-22bb3b3b1336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.734293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-91af5059-21bd-4e02-9e98-22bb3b3b1336 None None] MFA Rules not processed for user `a0794c7a4d5e416caccfa3bd6ce5ea17`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:32.735524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-91af5059-21bd-4e02-9e98-22bb3b3b1336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.746392 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 839/1689] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:32.747302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79b06b-d3be-4a81-b6d3-619b794d1776 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:32.755402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1a79b06b-d3be-4a81-b6d3-619b794d1776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.789573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79b06b-d3be-4a81-b6d3-619b794d1776 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:32.810902 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:32.811615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.812003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.812347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.813144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:32.817553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:32.846833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 840/1690] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:32.858522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:32.862428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.907218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 851/1691] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:32.908828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5059-21bd-4e02-9e98-22bb3b3b1336 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:32.917025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-91af5059-21bd-4e02-9e98-22bb3b3b1336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.935500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5059-21bd-4e02-9e98-22bb3b3b1336 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:32.945084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:32.946358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.946939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.947442 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] PATH_INFO: `/v3/users/8e0513a3b6794c91aa17caad80ae57d9` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.949021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0513a3b6794c91aa17caad80ae57d9)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:32.951239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:32.978765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263947-bcc0-4f02-b8da-981c3e161e0c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:32.985987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a45e57-fcab-41f1-b5b7-35f160df190f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:32.988536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a45e57-fcab-41f1-b5b7-35f160df190f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.988842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a45e57-fcab-41f1-b5b7-35f160df190f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.989400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a45e57-fcab-41f1-b5b7-35f160df190f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.992092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-72a45e57-fcab-41f1-b5b7-35f160df190f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.999764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:33.008205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a45e57-fcab-41f1-b5b7-35f160df190f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:33.010005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a45e57-fcab-41f1-b5b7-35f160df190f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:33.040402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 841/1692] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:33.048133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6168f4-ae32-4022-9e12-188071bcfa4b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:33.048831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6168f4-ae32-4022-9e12-188071bcfa4b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:33.049576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6168f4-ae32-4022-9e12-188071bcfa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:33.051197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0513a3b6794c91aa17caad80ae57d9'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:33.078069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0513a3b6794c91aa17caad80ae57d9'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:33.079854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0513a3b6794c91aa17caad80ae57d9'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:33.081699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5b6168f4-ae32-4022-9e12-188071bcfa4b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:33.092094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5b6168f4-ae32-4022-9e12-188071bcfa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:33.106822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 842/1693] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:33.109267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0513a3b6794c91aa17caad80ae57d9'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:33.113193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6168f4-ae32-4022-9e12-188071bcfa4b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:33.115287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5b6168f4-ae32-4022-9e12-188071bcfa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:33.122416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0513a3b6794c91aa17caad80ae57d9'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:33.133773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 852/1694] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:32 2022] DELETE /identity/v3/users/8e0513a3b6794c91aa17caad80ae57d9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:33.135134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:33.137966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:33.139829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6168f4-ae32-4022-9e12-188071bcfa4b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:33.227911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:33.323556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6605e5e-fa16-4256-8b4f-045dba43826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:33.324498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6605e5e-fa16-4256-8b4f-045dba43826b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:33.324787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6605e5e-fa16-4256-8b4f-045dba43826b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:33.325069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6605e5e-fa16-4256-8b4f-045dba43826b admin admin] PATH_INFO: `/v3/projects/836cafb9b5c04d5489e692f0445cc39c/users/00df8a9eafbe4c458e57f20cab6f55f2/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:33.348879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3867f-9f54-4c70-9242-83bc675aece7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:33.379721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e7361-fa8a-4b72-9816-1e5627c9ab1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:33.381708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7361-fa8a-4b72-9816-1e5627c9ab1d service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:33.381708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7361-fa8a-4b72-9816-1e5627c9ab1d service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:33.381708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7361-fa8a-4b72-9816-1e5627c9ab1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:33.385792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-af3e7361-fa8a-4b72-9816-1e5627c9ab1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:33.390114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6605e5e-fa16-4256-8b4f-045dba43826b admin admin] RBAC: Authorizing `identity:create_grant(project_id=836cafb9b5c04d5489e692f0445cc39c, user_id=00df8a9eafbe4c458e57f20cab6f55f2, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:33.404186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6605e5e-fa16-4256-8b4f-045dba43826b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:33.483538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 843/1695] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:33 2022] PUT /identity/v3/projects/836cafb9b5c04d5489e692f0445cc39c/users/00df8a9eafbe4c458e57f20cab6f55f2/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:33.483538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6605e5e-fa16-4256-8b4f-045dba43826b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:33.601881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e7361-fa8a-4b72-9816-1e5627c9ab1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:33.603398 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e7361-fa8a-4b72-9816-1e5627c9ab1d service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:33.635418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 853/1696] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:33.643407 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0be2-742c-4b31-8020-37b6daa9a09f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:33.643715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0be2-742c-4b31-8020-37b6daa9a09f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:33.644006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0be2-742c-4b31-8020-37b6daa9a09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:33.649104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6605e5e-fa16-4256-8b4f-045dba43826b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:33.675103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:33.676180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:33.676180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:33.676372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:33.677104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:33.677422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:33.679143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:33.758246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 844/1697] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:33.759127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:33.769612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-17ae0be2-742c-4b31-8020-37b6daa9a09f None None] MFA Rules not processed for user `00df8a9eafbe4c458e57f20cab6f55f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:33.778885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-17ae0be2-742c-4b31-8020-37b6daa9a09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:33.801004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecbe52-5505-4c97-ae89-dddd86de7dea admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:33.833094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedcb08-91a2-445a-b614-3d889750461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:33.834104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedcb08-91a2-445a-b614-3d889750461f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:33.834403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedcb08-91a2-445a-b614-3d889750461f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:33.834693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedcb08-91a2-445a-b614-3d889750461f admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:33.836188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedcb08-91a2-445a-b614-3d889750461f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:33.837413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedcb08-91a2-445a-b614-3d889750461f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:33.927826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:33.948562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 845/1698] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:33 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:33.952864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedcb08-91a2-445a-b614-3d889750461f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:34.067541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 854/1699] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:34.080181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae0be2-742c-4b31-8020-37b6daa9a09f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:34.087664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-17ae0be2-742c-4b31-8020-37b6daa9a09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:34.167465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedcb08-91a2-445a-b614-3d889750461f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:34.183099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989d91-148d-4e18-8f69-19d379e2631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:34.183871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989d91-148d-4e18-8f69-19d379e2631e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:34.184222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989d91-148d-4e18-8f69-19d379e2631e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:34.184550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989d91-148d-4e18-8f69-19d379e2631e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:34.185381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989d91-148d-4e18-8f69-19d379e2631e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:34.187680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989d91-148d-4e18-8f69-19d379e2631e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:34.248216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 846/1700] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:33 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:34.252712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989d91-148d-4e18-8f69-19d379e2631e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:34.271167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae0be2-742c-4b31-8020-37b6daa9a09f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:34.272618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989d91-148d-4e18-8f69-19d379e2631e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:34.285070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6174d48-62f1-47ef-ab56-318c8364ec2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:34.285828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6174d48-62f1-47ef-ab56-318c8364ec2f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:34.286147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6174d48-62f1-47ef-ab56-318c8364ec2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:34.289671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6174d48-62f1-47ef-ab56-318c8364ec2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:34.290562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6174d48-62f1-47ef-ab56-318c8364ec2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:34.296409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6174d48-62f1-47ef-ab56-318c8364ec2f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:34.335808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 847/1701] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:33:34.339372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6174d48-62f1-47ef-ab56-318c8364ec2f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:34.363095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6174d48-62f1-47ef-ab56-318c8364ec2f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:34.385735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a65bb-965b-4269-8192-d9f8462485b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:34.386697 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a65bb-965b-4269-8192-d9f8462485b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:34.387017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a65bb-965b-4269-8192-d9f8462485b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:34.387300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a65bb-965b-4269-8192-d9f8462485b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:34.388047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a65bb-965b-4269-8192-d9f8462485b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:34.389725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a65bb-965b-4269-8192-d9f8462485b3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:34.419119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b805927-cfdf-416b-87a9-e831abb5f796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:34.419799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b805927-cfdf-416b-87a9-e831abb5f796 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:34.420089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b805927-cfdf-416b-87a9-e831abb5f796 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:34.420761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b805927-cfdf-416b-87a9-e831abb5f796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:34.428956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 848/1702] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:34.429986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a65bb-965b-4269-8192-d9f8462485b3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:34.453516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:34.472771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a65bb-965b-4269-8192-d9f8462485b3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:34.497922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f201-9abf-4429-bc81-bf1d371e1709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:34.498942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f201-9abf-4429-bc81-bf1d371e1709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:34.499241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f201-9abf-4429-bc81-bf1d371e1709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:34.499498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f201-9abf-4429-bc81-bf1d371e1709 admin admin] PATH_INFO: `/v3/projects/5db9975839a3410a91976963046b2c68/users/fbd9ee75067d4b078f729d01b794910d/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:34.561983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b805927-cfdf-416b-87a9-e831abb5f796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:34.565845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b805927-cfdf-416b-87a9-e831abb5f796 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:34.575353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846f201-9abf-4429-bc81-bf1d371e1709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db9975839a3410a91976963046b2c68, user_id=fbd9ee75067d4b078f729d01b794910d, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:34.585161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846f201-9abf-4429-bc81-bf1d371e1709 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:34.612815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 855/1703] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:34.631887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 849/1704] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:34 2022] PUT /identity/v3/projects/5db9975839a3410a91976963046b2c68/users/fbd9ee75067d4b078f729d01b794910d/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:34.644404 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29728712-3509-41ff-b18c-7c8344feef6f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:34.644766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29728712-3509-41ff-b18c-7c8344feef6f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:34.645451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29728712-3509-41ff-b18c-7c8344feef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:34.738883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-29728712-3509-41ff-b18c-7c8344feef6f None None] MFA Rules not processed for user `fbd9ee75067d4b078f729d01b794910d`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:34.743687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-29728712-3509-41ff-b18c-7c8344feef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:34.820821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5184e8-53b1-440e-9eb8-9d2a533d1c33 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:34.821356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5184e8-53b1-440e-9eb8-9d2a533d1c33 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:34.821449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5184e8-53b1-440e-9eb8-9d2a533d1c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:34.837988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:34.899898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4b5184e8-53b1-440e-9eb8-9d2a533d1c33 None None] MFA Rules not processed for user `4019001e534148e69c25c4d84b3a7f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:34.904084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4b5184e8-53b1-440e-9eb8-9d2a533d1c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:34.940052 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 856/1705] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:34.944735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29728712-3509-41ff-b18c-7c8344feef6f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:35.147205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29728712-3509-41ff-b18c-7c8344feef6f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:35.156342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cda27-2a94-420c-8f2a-a786aabe7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:35.158805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cda27-2a94-420c-8f2a-a786aabe7f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.160015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cda27-2a94-420c-8f2a-a786aabe7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.160439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cda27-2a94-420c-8f2a-a786aabe7f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.161988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cda27-2a94-420c-8f2a-a786aabe7f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:35.166505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cda27-2a94-420c-8f2a-a786aabe7f79 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:35.200436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 850/1706] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:35.230080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 857/1707] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:34 2022] POST /identity/v3/projects => generated 379 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:35.230461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5184e8-53b1-440e-9eb8-9d2a533d1c33 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:35.265535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5184e8-53b1-440e-9eb8-9d2a533d1c33 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:35.353764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77f9ef-7a0c-43a9-8685-b5997999f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:35.354987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f9ef-7a0c-43a9-8685-b5997999f3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.356049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f9ef-7a0c-43a9-8685-b5997999f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.356500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f9ef-7a0c-43a9-8685-b5997999f3bb admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.357491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77f9ef-7a0c-43a9-8685-b5997999f3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:35.361055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77f9ef-7a0c-43a9-8685-b5997999f3bb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:35.402324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb73fb8-39d5-4b0f-bf01-e877c38cfb8d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.402660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb73fb8-39d5-4b0f-bf01-e877c38cfb8d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.403087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb73fb8-39d5-4b0f-bf01-e877c38cfb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.445538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 851/1708] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:35 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:35.449367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77f9ef-7a0c-43a9-8685-b5997999f3bb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:35.466659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77f9ef-7a0c-43a9-8685-b5997999f3bb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:35.471512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6e58-91d1-4421-b98a-24b76dcdfda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:35.472199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6e58-91d1-4421-b98a-24b76dcdfda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.472604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6e58-91d1-4421-b98a-24b76dcdfda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.472886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6e58-91d1-4421-b98a-24b76dcdfda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.473762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c6e58-91d1-4421-b98a-24b76dcdfda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:35.475700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c6e58-91d1-4421-b98a-24b76dcdfda8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:35.490489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 852/1709] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:35.495184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6e58-91d1-4421-b98a-24b76dcdfda8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:35.508931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-2cb73fb8-39d5-4b0f-bf01-e877c38cfb8d None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:35.510304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2cb73fb8-39d5-4b0f-bf01-e877c38cfb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:35.544638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6e58-91d1-4421-b98a-24b76dcdfda8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:35.560524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc39d8-a091-4f0c-bbfc-89299bec5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:35.561443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc39d8-a091-4f0c-bbfc-89299bec5081 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.564225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc39d8-a091-4f0c-bbfc-89299bec5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.584211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc39d8-a091-4f0c-bbfc-89299bec5081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.587417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc39d8-a091-4f0c-bbfc-89299bec5081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:35.590765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc39d8-a091-4f0c-bbfc-89299bec5081 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:35.621723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 853/1710] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:35.626595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc39d8-a091-4f0c-bbfc-89299bec5081 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:35.647635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc39d8-a091-4f0c-bbfc-89299bec5081 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:35.654089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d5163-2c0f-4003-afeb-c95717711a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:35.655113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d5163-2c0f-4003-afeb-c95717711a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.655483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d5163-2c0f-4003-afeb-c95717711a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.657522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d5163-2c0f-4003-afeb-c95717711a6b admin admin] PATH_INFO: `/v3/projects/eaed88e74f3048c3af12177207505ee1/users/13f572172c434e2a88dbb22444004229/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.672320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 858/1711] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:35.699898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d5163-2c0f-4003-afeb-c95717711a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaed88e74f3048c3af12177207505ee1, user_id=13f572172c434e2a88dbb22444004229, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:35.706927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d5163-2c0f-4003-afeb-c95717711a6b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:35.759374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 854/1712] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:35 2022] PUT /identity/v3/projects/eaed88e74f3048c3af12177207505ee1/users/13f572172c434e2a88dbb22444004229/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:35.769293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37250-1883-4fd9-ba2d-9a3d7aeaca87 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.769718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37250-1883-4fd9-ba2d-9a3d7aeaca87 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.770012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37250-1883-4fd9-ba2d-9a3d7aeaca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.805401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a2b37250-1883-4fd9-ba2d-9a3d7aeaca87 None None] MFA Rules not processed for user `13f572172c434e2a88dbb22444004229`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:35.807609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a2b37250-1883-4fd9-ba2d-9a3d7aeaca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:35.828924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:35.903763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 859/1713] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:35.904969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d5163-2c0f-4003-afeb-c95717711a6b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:35.922970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37250-1883-4fd9-ba2d-9a3d7aeaca87 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:35.925521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a2b37250-1883-4fd9-ba2d-9a3d7aeaca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:35.937400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:36.071885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d5163-2c0f-4003-afeb-c95717711a6b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:36.077717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:36.079409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:36.079851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:36.080266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:36.081631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:36.084406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:36.096947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37250-1883-4fd9-ba2d-9a3d7aeaca87 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:36.105282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975e8ad-8516-49c4-b878-b0e101348e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:36.106003 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975e8ad-8516-49c4-b878-b0e101348e45 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:36.106431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975e8ad-8516-49c4-b878-b0e101348e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:36.106686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975e8ad-8516-49c4-b878-b0e101348e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:36.128154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 855/1714] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:35 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:36.128470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:36.132468 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:36.183833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975e8ad-8516-49c4-b878-b0e101348e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:36.186280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975e8ad-8516-49c4-b878-b0e101348e45 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:36.199280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 860/1715] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:36.200128 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975e8ad-8516-49c4-b878-b0e101348e45 service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:36.214438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975e8ad-8516-49c4-b878-b0e101348e45 service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:36.300837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:36.316896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0482af-f879-4d8e-99ac-e0bd220973a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:36.318322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0482af-f879-4d8e-99ac-e0bd220973a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:36.319112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0482af-f879-4d8e-99ac-e0bd220973a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:36.319405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0482af-f879-4d8e-99ac-e0bd220973a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:36.320115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0482af-f879-4d8e-99ac-e0bd220973a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:36.322092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0482af-f879-4d8e-99ac-e0bd220973a2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:36.392067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 861/1716] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:36 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:36.395796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0482af-f879-4d8e-99ac-e0bd220973a2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:36.440477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355188a-c3a6-4799-ba19-6ac1c219c68e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:36.441934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0482af-f879-4d8e-99ac-e0bd220973a2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:36.447203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eb469-7581-41d4-9f83-43584e6f5108 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:36.448146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eb469-7581-41d4-9f83-43584e6f5108 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:36.449047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eb469-7581-41d4-9f83-43584e6f5108 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:36.449690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eb469-7581-41d4-9f83-43584e6f5108 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:36.461675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65945e-3f66-4899-82d5-cf5f1e4fdac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:36.462539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65945e-3f66-4899-82d5-cf5f1e4fdac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:36.462889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65945e-3f66-4899-82d5-cf5f1e4fdac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:36.463184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65945e-3f66-4899-82d5-cf5f1e4fdac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:36.471301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65945e-3f66-4899-82d5-cf5f1e4fdac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:36.474980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65945e-3f66-4899-82d5-cf5f1e4fdac7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:36.525046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 862/1717] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:36.526487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65945e-3f66-4899-82d5-cf5f1e4fdac7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:36.529228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eb469-7581-41d4-9f83-43584e6f5108 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:36.531544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eb469-7581-41d4-9f83-43584e6f5108 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:36.542575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 856/1718] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:33:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:33:36.564418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65945e-3f66-4899-82d5-cf5f1e4fdac7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:36.595288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd718433-4a62-4133-9b31-b1d4f50da4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:36.595288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718433-4a62-4133-9b31-b1d4f50da4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:36.595288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718433-4a62-4133-9b31-b1d4f50da4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:36.595288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd718433-4a62-4133-9b31-b1d4f50da4ad admin admin] PATH_INFO: `/v3/projects/ec8b5e0573b04d3f90384504d2c60df0/users/d1085b3c4d33450ba65bbc25712f4932/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:36.674730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd718433-4a62-4133-9b31-b1d4f50da4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8b5e0573b04d3f90384504d2c60df0, user_id=d1085b3c4d33450ba65bbc25712f4932, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:36.678499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd718433-4a62-4133-9b31-b1d4f50da4ad admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:36.728696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 863/1719] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:36 2022] PUT /identity/v3/projects/ec8b5e0573b04d3f90384504d2c60df0/users/d1085b3c4d33450ba65bbc25712f4932/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:36.733192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eb469-7581-41d4-9f83-43584e6f5108 service swift] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:36.752318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eb469-7581-41d4-9f83-43584e6f5108 service swift] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:36.820435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:37.022496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:37.024585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:37.028437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:37.028904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:37.030398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:37.037457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:37.112130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd718433-4a62-4133-9b31-b1d4f50da4ad admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:37.127431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd718433-4a62-4133-9b31-b1d4f50da4ad admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:37.130222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 857/1720] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:33:37.160687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03037968-6c87-402f-8767-686f026a3d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:37.161654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03037968-6c87-402f-8767-686f026a3d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:37.161914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03037968-6c87-402f-8767-686f026a3d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:37.162210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03037968-6c87-402f-8767-686f026a3d09 admin admin] PATH_INFO: `/v3/projects/ec8b5e0573b04d3f90384504d2c60df0/users/d1085b3c4d33450ba65bbc25712f4932/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:37.172995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03037968-6c87-402f-8767-686f026a3d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8b5e0573b04d3f90384504d2c60df0, user_id=d1085b3c4d33450ba65bbc25712f4932, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:37.180888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03037968-6c87-402f-8767-686f026a3d09 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:37.185763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:37.188143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:37.237135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24578157-05ba-4c76-8b95-6e7d3985eaa7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:37.280688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 864/1721] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:37 2022] PUT /identity/v3/projects/ec8b5e0573b04d3f90384504d2c60df0/users/d1085b3c4d33450ba65bbc25712f4932/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:33:37.293861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d57743-c4b3-4b31-bb58-5f9bdd9afeb8 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:37.294412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d57743-c4b3-4b31-bb58-5f9bdd9afeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:37.294876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d57743-c4b3-4b31-bb58-5f9bdd9afeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:37.476423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-49d57743-c4b3-4b31-bb58-5f9bdd9afeb8 None None] MFA Rules not processed for user `d1085b3c4d33450ba65bbc25712f4932`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:37.479041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-49d57743-c4b3-4b31-bb58-5f9bdd9afeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:37.612967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:37.613943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:37.619259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:37.619764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] PATH_INFO: `/v3/projects/9d479457ebdc4acfb79056a9787ca9b6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:37.626490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d479457ebdc4acfb79056a9787ca9b6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:37.628581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:37.636014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 865/1722] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:37.904378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d57743-c4b3-4b31-bb58-5f9bdd9afeb8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:37.912988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d479457ebdc4acfb79056a9787ca9b6', 'request_id': 'req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:37.958959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d479457ebdc4acfb79056a9787ca9b6', 'request_id': 'req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:37.980950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d479457ebdc4acfb79056a9787ca9b6', 'request_id': 'req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:38.034945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] The token cache is being invalidate because project 9d479457ebdc4acfb79056a9787ca9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:38.035666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:38.047879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3aff8fdf-b079-4ab4-92fb-2fe201978cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:38.054081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 858/1723] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:37 2022] DELETE /identity/v3/projects/9d479457ebdc4acfb79056a9787ca9b6 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:33:38.059378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be16500-032b-4845-b26b-250d2dcbfcc7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:38.062693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be16500-032b-4845-b26b-250d2dcbfcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:38.064041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be16500-032b-4845-b26b-250d2dcbfcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:38.169059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6be16500-032b-4845-b26b-250d2dcbfcc7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:38.170553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6be16500-032b-4845-b26b-250d2dcbfcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:38.260187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d57743-c4b3-4b31-bb58-5f9bdd9afeb8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:38.417318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:38.452277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:38.484414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 859/1724] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:38.486653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281f0f-dcc7-4275-abbd-35b061567465 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:38.487195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281f0f-dcc7-4275-abbd-35b061567465 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:38.487821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281f0f-dcc7-4275-abbd-35b061567465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:38.523467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e9281f0f-dcc7-4275-abbd-35b061567465 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:38.525177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e9281f0f-dcc7-4275-abbd-35b061567465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:38.540261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 860/1725] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:38.541323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9281f0f-dcc7-4275-abbd-35b061567465 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:38.555482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:38.559288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:38.561460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:38.562060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:38.564258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9281f0f-dcc7-4275-abbd-35b061567465 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:38.570260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:38.586973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:38.589770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:38.589918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:38.593570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:38.596841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:38.599442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:38.607072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:38.649193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 861/1726] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:38.650663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:38.713099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb7154-0bb8-42f9-a8ef-1fb18fbef8e1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:38.732471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c32390-29b5-4f84-957f-8c5c13357891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:38.733213 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32390-29b5-4f84-957f-8c5c13357891 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:38.733538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32390-29b5-4f84-957f-8c5c13357891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:38.733823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32390-29b5-4f84-957f-8c5c13357891 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:38.741452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c32390-29b5-4f84-957f-8c5c13357891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:38.743445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c32390-29b5-4f84-957f-8c5c13357891 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:38.853286 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 862/1727] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:38 2022] POST /identity/v3/projects => generated 409 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:38.854621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c32390-29b5-4f84-957f-8c5c13357891 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:38.855677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:38.862121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:38.903317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 866/1728] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 1000 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:38.996174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:38.998555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:39.049409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa21d4-37aa-491a-914f-a16bee9da719 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:39.140567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c32390-29b5-4f84-957f-8c5c13357891 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:39.159524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f039b-2d9c-4ef8-ad11-6c883558ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:39.164289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f039b-2d9c-4ef8-ad11-6c883558ddcf admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:39.165375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f039b-2d9c-4ef8-ad11-6c883558ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:39.165375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f039b-2d9c-4ef8-ad11-6c883558ddcf admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:39.166035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f039b-2d9c-4ef8-ad11-6c883558ddcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:39.171524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f039b-2d9c-4ef8-ad11-6c883558ddcf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:39.233550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 863/1729] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:38 2022] POST /identity/v3/users => generated 305 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:39.235589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f039b-2d9c-4ef8-ad11-6c883558ddcf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:39.272872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f039b-2d9c-4ef8-ad11-6c883558ddcf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:39.282560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98324d1-c065-46f0-a1bc-9d0b14fa9864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:39.284592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98324d1-c065-46f0-a1bc-9d0b14fa9864 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:39.284864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98324d1-c065-46f0-a1bc-9d0b14fa9864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:39.285148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98324d1-c065-46f0-a1bc-9d0b14fa9864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:39.289378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d108a9-4eaa-4775-9dce-65fb999d222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:39.291432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d108a9-4eaa-4775-9dce-65fb999d222b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:39.292446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f98324d1-c065-46f0-a1bc-9d0b14fa9864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:39.292680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d108a9-4eaa-4775-9dce-65fb999d222b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:39.294065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d108a9-4eaa-4775-9dce-65fb999d222b admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:39.295915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d108a9-4eaa-4775-9dce-65fb999d222b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:39.302088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d108a9-4eaa-4775-9dce-65fb999d222b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:39.339947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 864/1730] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:39.344834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d108a9-4eaa-4775-9dce-65fb999d222b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:39.388444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d108a9-4eaa-4775-9dce-65fb999d222b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:39.405789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cecc32-8993-4721-a2b8-6be7a37dfa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:39.407331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cecc32-8993-4721-a2b8-6be7a37dfa43 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:39.407623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cecc32-8993-4721-a2b8-6be7a37dfa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:39.409232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cecc32-8993-4721-a2b8-6be7a37dfa43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:39.411538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cecc32-8993-4721-a2b8-6be7a37dfa43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:39.413943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cecc32-8993-4721-a2b8-6be7a37dfa43 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:39.457963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 865/1731] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:33:39.464550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cecc32-8993-4721-a2b8-6be7a37dfa43 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:39.515409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cecc32-8993-4721-a2b8-6be7a37dfa43 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:39.541130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ad9c5-2ec0-4e5c-b33c-92d50a91eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:39.542287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad9c5-2ec0-4e5c-b33c-92d50a91eed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:39.542661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad9c5-2ec0-4e5c-b33c-92d50a91eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:39.543102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad9c5-2ec0-4e5c-b33c-92d50a91eed8 admin admin] PATH_INFO: `/v3/projects/b28613b636754fd99d7b3eed7e288743/users/1ba6784875834092b64f349d50fb61a3/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:39.548255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98324d1-c065-46f0-a1bc-9d0b14fa9864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:39.549723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98324d1-c065-46f0-a1bc-9d0b14fa9864 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:39.611182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 867/1732] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:39.613743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ad9c5-2ec0-4e5c-b33c-92d50a91eed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28613b636754fd99d7b3eed7e288743, user_id=1ba6784875834092b64f349d50fb61a3, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:39.617513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ad9c5-2ec0-4e5c-b33c-92d50a91eed8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:39.664289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 866/1733] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:39 2022] PUT /identity/v3/projects/b28613b636754fd99d7b3eed7e288743/users/1ba6784875834092b64f349d50fb61a3/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:39.679173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b11ed-8da6-47fd-aebc-34055372f826 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:39.679541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b11ed-8da6-47fd-aebc-34055372f826 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:39.679928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b11ed-8da6-47fd-aebc-34055372f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:39.816799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-298b11ed-8da6-47fd-aebc-34055372f826 None None] MFA Rules not processed for user `1ba6784875834092b64f349d50fb61a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:39.830378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-298b11ed-8da6-47fd-aebc-34055372f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:39.985776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:40.230657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 868/1734] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 553 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:40.235437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ad9c5-2ec0-4e5c-b33c-92d50a91eed8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:40.480411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:40.536583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ad9c5-2ec0-4e5c-b33c-92d50a91eed8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:40.553766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d23c1-819d-49bf-a4b4-5413b97feadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:40.555220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d23c1-819d-49bf-a4b4-5413b97feadf admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:40.555452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d23c1-819d-49bf-a4b4-5413b97feadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:40.555870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d23c1-819d-49bf-a4b4-5413b97feadf admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:40.556465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d23c1-819d-49bf-a4b4-5413b97feadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:40.559779 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d23c1-819d-49bf-a4b4-5413b97feadf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:40.673849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b11ed-8da6-47fd-aebc-34055372f826 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:40.693699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 867/1735] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:40 2022] POST /identity/v3/projects => generated 407 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:40.712997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b11ed-8da6-47fd-aebc-34055372f826 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:41.040882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6af3f-2f44-4170-9ce7-0df36c968eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:41.041600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6af3f-2f44-4170-9ce7-0df36c968eae admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.041893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6af3f-2f44-4170-9ce7-0df36c968eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.042179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6af3f-2f44-4170-9ce7-0df36c968eae admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:41.064334 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6af3f-2f44-4170-9ce7-0df36c968eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:41.069072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6af3f-2f44-4170-9ce7-0df36c968eae admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:41.139801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 869/1736] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:40 2022] POST /identity/v3/users => generated 310 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:33:41.145216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d23c1-819d-49bf-a4b4-5413b97feadf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:41.146355 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3741b-4707-4a21-95c5-201ab91c0f36 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.146801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3741b-4707-4a21-95c5-201ab91c0f36 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.147097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3741b-4707-4a21-95c5-201ab91c0f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:41.167515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d23c1-819d-49bf-a4b4-5413b97feadf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:41.184103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-82a3741b-4707-4a21-95c5-201ab91c0f36 None None] MFA Rules not processed for user `18d55b1fd69640548e7b35258e33e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:41.187326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-82a3741b-4707-4a21-95c5-201ab91c0f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:41.195928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610f79b-1ec4-4419-821f-55bcd37ab7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:41.199118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610f79b-1ec4-4419-821f-55bcd37ab7fb admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.206333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610f79b-1ec4-4419-821f-55bcd37ab7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.206816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610f79b-1ec4-4419-821f-55bcd37ab7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:41.209204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610f79b-1ec4-4419-821f-55bcd37ab7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:41.219519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610f79b-1ec4-4419-821f-55bcd37ab7fb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:41.315220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 868/1737] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:41.321182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610f79b-1ec4-4419-821f-55bcd37ab7fb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:41.381983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 870/1738] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jul 12 14:33:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:41.408422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610f79b-1ec4-4419-821f-55bcd37ab7fb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:41.439847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3c44-44c5-4c0e-986e-117ada7e669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:41.445547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3c44-44c5-4c0e-986e-117ada7e669e admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.445864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3c44-44c5-4c0e-986e-117ada7e669e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.446180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3c44-44c5-4c0e-986e-117ada7e669e admin admin] PATH_INFO: `/v3/projects/28457a255a754f558398515a0a770d19/users/25217a6678784a208a90265a3070d773/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:41.516766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae3c44-44c5-4c0e-986e-117ada7e669e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28457a255a754f558398515a0a770d19, user_id=25217a6678784a208a90265a3070d773, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:41.536596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae3c44-44c5-4c0e-986e-117ada7e669e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:41.554452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3741b-4707-4a21-95c5-201ab91c0f36 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:41.554452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-82a3741b-4707-4a21-95c5-201ab91c0f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:41.573999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3741b-4707-4a21-95c5-201ab91c0f36 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:41.614175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b100a4-0e12-48b2-9757-fad6a32a4f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:41.618196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 869/1739] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:41 2022] PUT /identity/v3/projects/28457a255a754f558398515a0a770d19/users/25217a6678784a208a90265a3070d773/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:41.621869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3c44-44c5-4c0e-986e-117ada7e669e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:41.623483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b100a4-0e12-48b2-9757-fad6a32a4f6f service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.625666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b100a4-0e12-48b2-9757-fad6a32a4f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.625992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b100a4-0e12-48b2-9757-fad6a32a4f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:41.685029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b100a4-0e12-48b2-9757-fad6a32a4f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:41.686526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b100a4-0e12-48b2-9757-fad6a32a4f6f service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:41.762286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 871/1740] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:41.840234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3c44-44c5-4c0e-986e-117ada7e669e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:41.846860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b809c7-541a-4a84-9001-3bc42f585c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:41.861333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b809c7-541a-4a84-9001-3bc42f585c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.861939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b809c7-541a-4a84-9001-3bc42f585c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.862788 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b809c7-541a-4a84-9001-3bc42f585c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:41.864078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b809c7-541a-4a84-9001-3bc42f585c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:41.869366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b809c7-541a-4a84-9001-3bc42f585c8d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:41.903079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058767d-ba2a-4e6d-abe1-6e23271d7afe None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.903408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058767d-ba2a-4e6d-abe1-6e23271d7afe None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.906202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058767d-ba2a-4e6d-abe1-6e23271d7afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:41.906668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 870/1741] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:33:41.910376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b809c7-541a-4a84-9001-3bc42f585c8d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:41.938737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b809c7-541a-4a84-9001-3bc42f585c8d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:41.955192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab571e-33f9-4656-b9ef-15d6d58ddca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:41.955192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab571e-33f9-4656-b9ef-15d6d58ddca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.955192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab571e-33f9-4656-b9ef-15d6d58ddca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.955192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab571e-33f9-4656-b9ef-15d6d58ddca7 admin admin] PATH_INFO: `/v3/projects/28457a255a754f558398515a0a770d19/users/25217a6678784a208a90265a3070d773/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:41.955494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab571e-33f9-4656-b9ef-15d6d58ddca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28457a255a754f558398515a0a770d19, user_id=25217a6678784a208a90265a3070d773, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:41.956543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab571e-33f9-4656-b9ef-15d6d58ddca7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:41.970161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 871/1742] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:41 2022] PUT /identity/v3/projects/28457a255a754f558398515a0a770d19/users/25217a6678784a208a90265a3070d773/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:41.973803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7058767d-ba2a-4e6d-abe1-6e23271d7afe None None] MFA Rules not processed for user `4019001e534148e69c25c4d84b3a7f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:41.975157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7058767d-ba2a-4e6d-abe1-6e23271d7afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:41.980907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bcae6-be53-445a-8932-d06c7cc73c6d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:41.981206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bcae6-be53-445a-8932-d06c7cc73c6d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:41.981495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bcae6-be53-445a-8932-d06c7cc73c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:42.051320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-559bcae6-be53-445a-8932-d06c7cc73c6d None None] MFA Rules not processed for user `25217a6678784a208a90265a3070d773`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:42.058172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-559bcae6-be53-445a-8932-d06c7cc73c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:42.169087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:42.202474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 872/1743] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:42.329060 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 872/1744] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:41 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:42.346719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058767d-ba2a-4e6d-abe1-6e23271d7afe None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:42.477283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058767d-ba2a-4e6d-abe1-6e23271d7afe None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:42.490829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a9fd1-f963-43d8-9bb0-9a692d4ac393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:42.490996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9fd1-f963-43d8-9bb0-9a692d4ac393 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:42.491554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9fd1-f963-43d8-9bb0-9a692d4ac393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:42.491554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9fd1-f963-43d8-9bb0-9a692d4ac393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:42.509800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a9fd1-f963-43d8-9bb0-9a692d4ac393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:42.509800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a9fd1-f963-43d8-9bb0-9a692d4ac393 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:42.553144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 873/1745] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:43.266360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bcae6-be53-445a-8932-d06c7cc73c6d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:43.269256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-559bcae6-be53-445a-8932-d06c7cc73c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:43.366298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:43.378594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bcae6-be53-445a-8932-d06c7cc73c6d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:43.390219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:43.391333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:43.391845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:43.392399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:43.566386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:43.568045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:43.589756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 873/1746] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:43.964011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c008c0-dc03-41c1-927e-ccf85017888c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:43.964501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c008c0-dc03-41c1-927e-ccf85017888c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:43.964597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c008c0-dc03-41c1-927e-ccf85017888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:44.012866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-35c008c0-dc03-41c1-927e-ccf85017888c None None] MFA Rules not processed for user `3522c9dae7854c2395b6a00a9094b10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:44.014121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-35c008c0-dc03-41c1-927e-ccf85017888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:44.205823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 874/1747] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:46.426507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:46.429001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:46.603603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ac50-1b52-45b2-83f4-fd7251de937a service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:46.613309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:46.614536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:46.614875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:46.615165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] PATH_INFO: `/v3/users/fbd9ee75067d4b078f729d01b794910d` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:46.616857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd9ee75067d4b078f729d01b794910d)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:46.621387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:46.784702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd9ee75067d4b078f729d01b794910d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:46.785814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd9ee75067d4b078f729d01b794910d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:46.804666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd9ee75067d4b078f729d01b794910d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:46.827603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd9ee75067d4b078f729d01b794910d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:46.863415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd9ee75067d4b078f729d01b794910d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:46.877118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 874/1748] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:46 2022] DELETE /identity/v3/users/fbd9ee75067d4b078f729d01b794910d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:46.882363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f808ca-80cc-4591-8feb-18e8ceb67b7e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:46.882955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f808ca-80cc-4591-8feb-18e8ceb67b7e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:46.883931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f808ca-80cc-4591-8feb-18e8ceb67b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:46.928018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-79f808ca-80cc-4591-8feb-18e8ceb67b7e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:46.930176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-79f808ca-80cc-4591-8feb-18e8ceb67b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:47.072418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 875/1749] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:47.083115 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:47.084421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:47.194628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:47.276050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279463-0335-405a-a4d4-b5f6e408011f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:47.286929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ba2de-d8b0-4dae-8d71-a2be6485ab58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:47.287879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba2de-d8b0-4dae-8d71-a2be6485ab58 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:47.289869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba2de-d8b0-4dae-8d71-a2be6485ab58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:47.290333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ba2de-d8b0-4dae-8d71-a2be6485ab58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:47.339424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ba2de-d8b0-4dae-8d71-a2be6485ab58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:47.343224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ba2de-d8b0-4dae-8d71-a2be6485ab58 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:47.390005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 875/1750] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:47.559626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a2c8-b832-427e-9a0e-714467c94aa2 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:47.560788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a2c8-b832-427e-9a0e-714467c94aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:47.561386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a2c8-b832-427e-9a0e-714467c94aa2 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:47.567246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 876/1751] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:33:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:47.785476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7f5b-314f-4cb0-a031-58e2ec5c6fed None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:47.786150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7f5b-314f-4cb0-a031-58e2ec5c6fed None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:47.786421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7f5b-314f-4cb0-a031-58e2ec5c6fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:47.859046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4b4e7f5b-314f-4cb0-a031-58e2ec5c6fed None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:47.864471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4b4e7f5b-314f-4cb0-a031-58e2ec5c6fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:48.160572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 876/1752] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:33:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:48.294696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a2c8-b832-427e-9a0e-714467c94aa2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:48.298213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5e22a2c8-b832-427e-9a0e-714467c94aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:48.362501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a2c8-b832-427e-9a0e-714467c94aa2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:48.390379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:48.393115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:48.399157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:48.402168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] PATH_INFO: `/v3/projects/5db9975839a3410a91976963046b2c68` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:48.406626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db9975839a3410a91976963046b2c68)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:48.418136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:48.615501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:48.632730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db9975839a3410a91976963046b2c68', 'request_id': 'req-0753bba6-22d6-4a8c-95ae-819a7e9543da'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:48.659430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db9975839a3410a91976963046b2c68', 'request_id': 'req-0753bba6-22d6-4a8c-95ae-819a7e9543da'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:48.670909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db9975839a3410a91976963046b2c68', 'request_id': 'req-0753bba6-22d6-4a8c-95ae-819a7e9543da'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:48.717373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] The token cache is being invalidate because project 5db9975839a3410a91976963046b2c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:48.718278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:48.721673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:48.732477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 877/1753] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:48 2022] DELETE /identity/v3/projects/5db9975839a3410a91976963046b2c68 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:48.733656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7f5b-314f-4cb0-a031-58e2ec5c6fed None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:48.759648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7f5b-314f-4cb0-a031-58e2ec5c6fed None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:48.939326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:48.940265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:48.940553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:48.940841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] PATH_INFO: `/v3/users/13f572172c434e2a88dbb22444004229` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:48.949633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f572172c434e2a88dbb22444004229)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:48.955972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:49.112539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f572172c434e2a88dbb22444004229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:49.114747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f572172c434e2a88dbb22444004229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:49.133692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f572172c434e2a88dbb22444004229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:49.148215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:49.157969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f572172c434e2a88dbb22444004229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:49.211858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f572172c434e2a88dbb22444004229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:49.232058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 877/1754] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:48 2022] DELETE /identity/v3/users/13f572172c434e2a88dbb22444004229 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:50.080297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:50.082541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:50.175804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:50.178100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:50.350711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d80b-8cd1-48e2-8696-60c8860d7f87 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:50.356912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:50.358734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:50.359863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:50.360368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] PATH_INFO: `/v3/projects/eaed88e74f3048c3af12177207505ee1` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:50.362333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaed88e74f3048c3af12177207505ee1)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:50.365089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:50.450707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaed88e74f3048c3af12177207505ee1', 'request_id': 'req-f494120d-f67f-42c8-beca-954c80f1339a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.458226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaed88e74f3048c3af12177207505ee1', 'request_id': 'req-f494120d-f67f-42c8-beca-954c80f1339a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.467584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaed88e74f3048c3af12177207505ee1', 'request_id': 'req-f494120d-f67f-42c8-beca-954c80f1339a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.483435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753bba6-22d6-4a8c-95ae-819a7e9543da admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:50.495727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] The token cache is being invalidate because project eaed88e74f3048c3af12177207505ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:50.496346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.499419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.513184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 878/1755] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:50 2022] DELETE /identity/v3/projects/eaed88e74f3048c3af12177207505ee1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:33:50.524496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:50.524496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:50.733586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:50.735324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:50.735608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:50.736806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494120d-f67f-42c8-beca-954c80f1339a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:50.737279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:50.749392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:50.755892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:50.760567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:50.761193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:50.761627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] PATH_INFO: `/v3/users/d1085b3c4d33450ba65bbc25712f4932` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:50.766491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1085b3c4d33450ba65bbc25712f4932)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:50.769866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:50.780113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:50.786526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:50.787137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:50.818206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 878/1756] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:50.920487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1085b3c4d33450ba65bbc25712f4932'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.927337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1085b3c4d33450ba65bbc25712f4932'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.946172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1085b3c4d33450ba65bbc25712f4932'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.960104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1085b3c4d33450ba65bbc25712f4932'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.983985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-eb2337f2-6bf3-4a93-9063-a576cb86e916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1085b3c4d33450ba65bbc25712f4932'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:50.994614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 879/1757] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:50 2022] DELETE /identity/v3/users/d1085b3c4d33450ba65bbc25712f4932 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:51.381620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:51.384850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:51.461985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c25bb3-60a6-430d-8c7f-77b63f9ab80e service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:51.635488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:51.644057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:51.668978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:51.668978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:51.668978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] PATH_INFO: `/v3/users/1ba6784875834092b64f349d50fb61a3` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:51.668978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba6784875834092b64f349d50fb61a3)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:51.668978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:51.771627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba6784875834092b64f349d50fb61a3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:51.814081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba6784875834092b64f349d50fb61a3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:51.815748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba6784875834092b64f349d50fb61a3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:51.839561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba6784875834092b64f349d50fb61a3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:51.851091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba6784875834092b64f349d50fb61a3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:51.874547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 879/1758] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:51 2022] DELETE /identity/v3/users/1ba6784875834092b64f349d50fb61a3 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:51.877148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e06a-2030-4f8a-8dc4-bf31b77e8587 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:51.877645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e06a-2030-4f8a-8dc4-bf31b77e8587 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:51.877723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e06a-2030-4f8a-8dc4-bf31b77e8587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:51.941927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-52b6e06a-2030-4f8a-8dc4-bf31b77e8587 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:51.945591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-52b6e06a-2030-4f8a-8dc4-bf31b77e8587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:52.058170 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 880/1759] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:52.129651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:52.131815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:52.321140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee9a12-1414-45cb-8bc0-5a510383af6f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:52.326526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317f9b5-07ff-4c5f-a7e2-2113096d5bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:52.327440 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317f9b5-07ff-4c5f-a7e2-2113096d5bfd service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:52.327655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317f9b5-07ff-4c5f-a7e2-2113096d5bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:52.327827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317f9b5-07ff-4c5f-a7e2-2113096d5bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:52.350079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317f9b5-07ff-4c5f-a7e2-2113096d5bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:52.351673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317f9b5-07ff-4c5f-a7e2-2113096d5bfd service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:52.374177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 880/1760] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:53.015152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e06a-2030-4f8a-8dc4-bf31b77e8587 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:53.018237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-52b6e06a-2030-4f8a-8dc4-bf31b77e8587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:53.034081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e06a-2030-4f8a-8dc4-bf31b77e8587 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:53.041930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:53.042980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:53.049699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:53.050254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] PATH_INFO: `/v3/projects/ec8b5e0573b04d3f90384504d2c60df0` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:53.052915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8b5e0573b04d3f90384504d2c60df0)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:53.055409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:53.167865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8b5e0573b04d3f90384504d2c60df0', 'request_id': 'req-cb026949-a0f3-459c-b24c-e5fc5eb424da'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:53.181845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8b5e0573b04d3f90384504d2c60df0', 'request_id': 'req-cb026949-a0f3-459c-b24c-e5fc5eb424da'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:53.197186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8b5e0573b04d3f90384504d2c60df0', 'request_id': 'req-cb026949-a0f3-459c-b24c-e5fc5eb424da'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:53.230904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] The token cache is being invalidate because project ec8b5e0573b04d3f90384504d2c60df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:53.231332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:53.233735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cb026949-a0f3-459c-b24c-e5fc5eb424da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:53.241116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 881/1761] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:53 2022] DELETE /identity/v3/projects/ec8b5e0573b04d3f90384504d2c60df0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:53.250376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc105b-5a0d-4a79-85e1-9e0617a3baf9 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:53.251280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc105b-5a0d-4a79-85e1-9e0617a3baf9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:53.251734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc105b-5a0d-4a79-85e1-9e0617a3baf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:53.307554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-65bc105b-5a0d-4a79-85e1-9e0617a3baf9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:53.315765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-65bc105b-5a0d-4a79-85e1-9e0617a3baf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:53.461109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 881/1762] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:53.465477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa461-fdde-4baa-a378-90fad56fdcde None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:53.465793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa461-fdde-4baa-a378-90fad56fdcde None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:53.466180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa461-fdde-4baa-a378-90fad56fdcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:53.527956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c55aa461-fdde-4baa-a378-90fad56fdcde None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:53.529532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c55aa461-fdde-4baa-a378-90fad56fdcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:53.565542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 882/1763] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:53.569009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc105b-5a0d-4a79-85e1-9e0617a3baf9 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:53.603496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc105b-5a0d-4a79-85e1-9e0617a3baf9 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:53.617885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:53.620241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:53.625702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:53.631855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:53.633210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:53.633755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:53.635731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:53.666063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 882/1764] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:53.670543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa461-fdde-4baa-a378-90fad56fdcde None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:53.675848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:53.692460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa461-fdde-4baa-a378-90fad56fdcde None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:53.704972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b1e9-f791-4f94-8598-6ad477155a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:53.705674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b1e9-f791-4f94-8598-6ad477155a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:53.706433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b1e9-f791-4f94-8598-6ad477155a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:53.706433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b1e9-f791-4f94-8598-6ad477155a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:53.707277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61b1e9-f791-4f94-8598-6ad477155a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:53.709301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61b1e9-f791-4f94-8598-6ad477155a89 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:53.743841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 883/1765] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:53 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:53.745698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:53.755249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:53.760293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f07c3-34f2-44ac-87eb-0445f0460d39 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:53.916053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:53.916776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:53.917071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:53.919530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:53.919530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:53.920763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:53.950231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 883/1766] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:53 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:53.958556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b1e9-f791-4f94-8598-6ad477155a89 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:53.973016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:53.976351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b1e9-f791-4f94-8598-6ad477155a89 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:53.982062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:53.994307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77736e-97ae-488a-80b3-fbeda202924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:53.995041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77736e-97ae-488a-80b3-fbeda202924d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:53.995338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77736e-97ae-488a-80b3-fbeda202924d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:53.995623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77736e-97ae-488a-80b3-fbeda202924d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:53.996375 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77736e-97ae-488a-80b3-fbeda202924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:54.002748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77736e-97ae-488a-80b3-fbeda202924d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:54.007286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c65db-ab9a-41f9-a056-51875d6c595d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:54.031955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:54.036983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:54.040266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:54.040571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] PATH_INFO: `/v3/projects/b28613b636754fd99d7b3eed7e288743` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:54.042674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28613b636754fd99d7b3eed7e288743)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:54.047450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:54.047590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 884/1767] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:54.048433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77736e-97ae-488a-80b3-fbeda202924d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:54.075414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77736e-97ae-488a-80b3-fbeda202924d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:54.095699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98593-5c1c-4f92-a115-0ed0948d2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:54.096391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98593-5c1c-4f92-a115-0ed0948d2fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:54.097009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98593-5c1c-4f92-a115-0ed0948d2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:54.097452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98593-5c1c-4f92-a115-0ed0948d2fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:54.110436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c98593-5c1c-4f92-a115-0ed0948d2fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:54.112389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c98593-5c1c-4f92-a115-0ed0948d2fcd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:54.160558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 885/1768] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:54.161708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98593-5c1c-4f92-a115-0ed0948d2fcd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:54.177947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28613b636754fd99d7b3eed7e288743', 'request_id': 'req-1d17e351-5f10-42ef-9f99-408557c426a1'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.207342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98593-5c1c-4f92-a115-0ed0948d2fcd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:54.207537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28613b636754fd99d7b3eed7e288743', 'request_id': 'req-1d17e351-5f10-42ef-9f99-408557c426a1'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.239995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28613b636754fd99d7b3eed7e288743', 'request_id': 'req-1d17e351-5f10-42ef-9f99-408557c426a1'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.293756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] The token cache is being invalidate because project b28613b636754fd99d7b3eed7e288743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:54.294980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.296152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.298341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 884/1769] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:53 2022] DELETE /identity/v3/projects/b28613b636754fd99d7b3eed7e288743 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:54.302350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:54.304753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:54.407411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17e351-5f10-42ef-9f99-408557c426a1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:54.411249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40896826-6bcb-4efe-a837-c82e895a00d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:54.412297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40896826-6bcb-4efe-a837-c82e895a00d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:54.412593 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40896826-6bcb-4efe-a837-c82e895a00d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:54.412869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40896826-6bcb-4efe-a837-c82e895a00d2 admin admin] PATH_INFO: `/v3/projects/49886d1bdc3f4027af7d16784d037097/users/6f53680f4e054bb3964a596ded8f05f3/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:54.414765 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:54.416392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:54.417237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:54.417706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] PATH_INFO: `/v3/users/25217a6678784a208a90265a3070d773` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:54.419720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25217a6678784a208a90265a3070d773)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:54.423903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:54.444609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40896826-6bcb-4efe-a837-c82e895a00d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49886d1bdc3f4027af7d16784d037097, user_id=6f53680f4e054bb3964a596ded8f05f3, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:54.451277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40896826-6bcb-4efe-a837-c82e895a00d2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:54.472176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:54.495724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 886/1770] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:54 2022] PUT /identity/v3/projects/49886d1bdc3f4027af7d16784d037097/users/6f53680f4e054bb3964a596ded8f05f3/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:54.507866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c455e-87ec-4702-8fe3-2701fd97acd6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:54.508322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c455e-87ec-4702-8fe3-2701fd97acd6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:54.508613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c455e-87ec-4702-8fe3-2701fd97acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:54.533624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25217a6678784a208a90265a3070d773'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.549727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25217a6678784a208a90265a3070d773'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.550560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25217a6678784a208a90265a3070d773'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.561691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25217a6678784a208a90265a3070d773'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.571693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25217a6678784a208a90265a3070d773'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:54.582838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 885/1771] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:54 2022] DELETE /identity/v3/users/25217a6678784a208a90265a3070d773 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:54.594475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a84c455e-87ec-4702-8fe3-2701fd97acd6 None None] MFA Rules not processed for user `6f53680f4e054bb3964a596ded8f05f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:54.597486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a84c455e-87ec-4702-8fe3-2701fd97acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:54.708390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 887/1772] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:54.733332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:54.737097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:54.865129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a3ccb-c6f7-4064-b326-e8910f030405 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:54.871007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697c6e1-55d0-43e1-842c-9b73c482da9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a81dce4c3ffd42bd85bf6e7687b5cbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:54.872750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697c6e1-55d0-43e1-842c-9b73c482da9d service glance] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:54.873228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697c6e1-55d0-43e1-842c-9b73c482da9d service glance] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:54.873786 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697c6e1-55d0-43e1-842c-9b73c482da9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:54.884543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697c6e1-55d0-43e1-842c-9b73c482da9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:54.886931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697c6e1-55d0-43e1-842c-9b73c482da9d service glance] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:54.911681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 886/1773] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:55.090037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3d6e-437e-4c6d-97d7-1ce3888433a2 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:55.090551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3d6e-437e-4c6d-97d7-1ce3888433a2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:55.090551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3d6e-437e-4c6d-97d7-1ce3888433a2 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:55.092214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 888/1774] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:55.108320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76618d04-46b2-4698-94f7-11589c8e696d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:55.108721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76618d04-46b2-4698-94f7-11589c8e696d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:55.108897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76618d04-46b2-4698-94f7-11589c8e696d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:55.159744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-76618d04-46b2-4698-94f7-11589c8e696d None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:55.161322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-76618d04-46b2-4698-94f7-11589c8e696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:55.290623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 887/1775] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:33:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:56.175151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3d6e-437e-4c6d-97d7-1ce3888433a2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:56.178082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5fda3d6e-437e-4c6d-97d7-1ce3888433a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:56.199948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3d6e-437e-4c6d-97d7-1ce3888433a2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:56.216036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880cd1e-8e96-4a19-9dff-5649f41a82aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:56.216758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880cd1e-8e96-4a19-9dff-5649f41a82aa service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:56.217251 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880cd1e-8e96-4a19-9dff-5649f41a82aa service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:56.217568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880cd1e-8e96-4a19-9dff-5649f41a82aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:56.227921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880cd1e-8e96-4a19-9dff-5649f41a82aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:56.229524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880cd1e-8e96-4a19-9dff-5649f41a82aa service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:56.241437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 889/1776] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:56.528970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76618d04-46b2-4698-94f7-11589c8e696d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:56.531455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-76618d04-46b2-4698-94f7-11589c8e696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:56.546476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:56.612091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76618d04-46b2-4698-94f7-11589c8e696d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:56.616666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:56.617799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:56.618249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:56.618696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] PATH_INFO: `/v3/projects/28457a255a754f558398515a0a770d19` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:56.620357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28457a255a754f558398515a0a770d19)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:56.622603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:56.682261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28457a255a754f558398515a0a770d19', 'request_id': 'req-d0158801-d309-43a1-9f00-f63c32204dd8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:56.688203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28457a255a754f558398515a0a770d19', 'request_id': 'req-d0158801-d309-43a1-9f00-f63c32204dd8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:56.696105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28457a255a754f558398515a0a770d19', 'request_id': 'req-d0158801-d309-43a1-9f00-f63c32204dd8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:56.710240 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] The token cache is being invalidate because project 28457a255a754f558398515a0a770d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:56.710536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:56.711298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d0158801-d309-43a1-9f00-f63c32204dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:56.712861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 888/1777] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:56 2022] DELETE /identity/v3/projects/28457a255a754f558398515a0a770d19 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:56.717941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8485-90f5-49c9-958d-972211dc21f1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:56.718436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8485-90f5-49c9-958d-972211dc21f1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:56.718731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8485-90f5-49c9-958d-972211dc21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:56.738296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-58dd8485-90f5-49c9-958d-972211dc21f1 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:56.739650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-58dd8485-90f5-49c9-958d-972211dc21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:56.771538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:56.819835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 890/1778] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:56.829708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf01e3-1ce0-44a1-beca-a9a56b167c8b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:56.829904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf01e3-1ce0-44a1-beca-a9a56b167c8b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:56.830489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf01e3-1ce0-44a1-beca-a9a56b167c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:56.850224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-04bf01e3-1ce0-44a1-beca-a9a56b167c8b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:56.857472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-04bf01e3-1ce0-44a1-beca-a9a56b167c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:56.869874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 889/1779] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:56.871274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8485-90f5-49c9-958d-972211dc21f1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:56.882118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8485-90f5-49c9-958d-972211dc21f1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:56.889721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:56.890597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:56.891119 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:56.891370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:56.892281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:56.892664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:56.894345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:56.909516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 891/1780] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:56.914328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf01e3-1ce0-44a1-beca-a9a56b167c8b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:56.924549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf01e3-1ce0-44a1-beca-a9a56b167c8b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:56.929536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b6298-957b-4978-9203-6d32812281d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:56.930205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b6298-957b-4978-9203-6d32812281d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:56.930488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b6298-957b-4978-9203-6d32812281d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:56.930764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b6298-957b-4978-9203-6d32812281d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:56.931481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b6298-957b-4978-9203-6d32812281d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:56.933522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b6298-957b-4978-9203-6d32812281d0 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:56.964720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:56.966556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:56.972481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 890/1781] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:56 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:56.976318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b6298-957b-4978-9203-6d32812281d0 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:56.981331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db4e1-f6fd-492c-95eb-3b8a02e384f0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.065991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b6298-957b-4978-9203-6d32812281d0 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.072885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75db8c-8267-4541-9234-21ace815d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.074057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75db8c-8267-4541-9234-21ace815d4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.074545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75db8c-8267-4541-9234-21ace815d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.075041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75db8c-8267-4541-9234-21ace815d4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.075989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75db8c-8267-4541-9234-21ace815d4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.079090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75db8c-8267-4541-9234-21ace815d4e8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:57.119983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.121938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.122535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.123297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] PATH_INFO: `/v3/users/00df8a9eafbe4c458e57f20cab6f55f2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.125737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00df8a9eafbe4c458e57f20cab6f55f2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.126190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 891/1782] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:56 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:33:57.132705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:57.132820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75db8c-8267-4541-9234-21ace815d4e8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:57.141541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:57.149651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75db8c-8267-4541-9234-21ace815d4e8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.159220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f897c7-71f0-4261-9637-ee8b6563837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.159926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f897c7-71f0-4261-9637-ee8b6563837e admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.160364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f897c7-71f0-4261-9637-ee8b6563837e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.160654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f897c7-71f0-4261-9637-ee8b6563837e admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.161954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f897c7-71f0-4261-9637-ee8b6563837e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.165162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f897c7-71f0-4261-9637-ee8b6563837e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:57.209577 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 892/1783] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:57.210647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f897c7-71f0-4261-9637-ee8b6563837e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:57.215036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00df8a9eafbe4c458e57f20cab6f55f2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:57.216522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00df8a9eafbe4c458e57f20cab6f55f2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:57.223311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f897c7-71f0-4261-9637-ee8b6563837e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.232946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.233998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.234632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.234932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.235459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00df8a9eafbe4c458e57f20cab6f55f2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:57.235748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.238020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:57.250853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00df8a9eafbe4c458e57f20cab6f55f2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:57.256603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 893/1784] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:57.257949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:57.259723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:57.270707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a857cb15-41af-4a04-b5e9-b7d4d9177c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00df8a9eafbe4c458e57f20cab6f55f2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:57.273415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a830d-7d3e-4188-ba0e-f812d2eaa9e6 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.278629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 892/1785] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:56 2022] DELETE /identity/v3/users/00df8a9eafbe4c458e57f20cab6f55f2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:33:57.285270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba8aa-afbb-4085-8786-2cc82945bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.285270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba8aa-afbb-4085-8786-2cc82945bbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.285270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba8aa-afbb-4085-8786-2cc82945bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.285270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba8aa-afbb-4085-8786-2cc82945bbdd admin admin] PATH_INFO: `/v3/projects/b8daf651ef564eaba986e82ec715e381/users/9b3c334f7c294da6a4d2563ef3da8361/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.285726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7568c2-5683-48bf-92c7-5be32d0df594 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.285946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7568c2-5683-48bf-92c7-5be32d0df594 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.286550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7568c2-5683-48bf-92c7-5be32d0df594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.314522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ba8aa-afbb-4085-8786-2cc82945bbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8daf651ef564eaba986e82ec715e381, user_id=9b3c334f7c294da6a4d2563ef3da8361, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.314699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bb7568c2-5683-48bf-92c7-5be32d0df594 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:57.315991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bb7568c2-5683-48bf-92c7-5be32d0df594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:57.317621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ba8aa-afbb-4085-8786-2cc82945bbdd admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:57.355236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:57.369708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 894/1786] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:57 2022] PUT /identity/v3/projects/b8daf651ef564eaba986e82ec715e381/users/9b3c334f7c294da6a4d2563ef3da8361/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:57.385613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b4a8-4aa0-41ac-a08c-46ee2a326c98 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.386089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b4a8-4aa0-41ac-a08c-46ee2a326c98 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.386387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b4a8-4aa0-41ac-a08c-46ee2a326c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.456322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 893/1787] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:57.468183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7ef3b4a8-4aa0-41ac-a08c-46ee2a326c98 None None] MFA Rules not processed for user `9b3c334f7c294da6a4d2563ef3da8361`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:57.470090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7ef3b4a8-4aa0-41ac-a08c-46ee2a326c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:57.470585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7568c2-5683-48bf-92c7-5be32d0df594 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:57.473708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bb7568c2-5683-48bf-92c7-5be32d0df594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:57.578944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 895/1788] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:57.580694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3b4a8-4aa0-41ac-a08c-46ee2a326c98 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:57.603107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7568c2-5683-48bf-92c7-5be32d0df594 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.673933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb861df5-8483-45b3-a161-bbf1ef2e676d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.674622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb861df5-8483-45b3-a161-bbf1ef2e676d service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.675289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb861df5-8483-45b3-a161-bbf1ef2e676d service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.675591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb861df5-8483-45b3-a161-bbf1ef2e676d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.678161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3b4a8-4aa0-41ac-a08c-46ee2a326c98 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.687568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875168bd-00f8-41f6-a062-6f38894b00a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.687731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb861df5-8483-45b3-a161-bbf1ef2e676d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.688775 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875168bd-00f8-41f6-a062-6f38894b00a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.689254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb861df5-8483-45b3-a161-bbf1ef2e676d service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:57.689489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875168bd-00f8-41f6-a062-6f38894b00a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.689970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875168bd-00f8-41f6-a062-6f38894b00a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.691149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875168bd-00f8-41f6-a062-6f38894b00a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.694717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875168bd-00f8-41f6-a062-6f38894b00a3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:57.703797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 894/1789] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:57.750177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 896/1790] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:57 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:33:57.754219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb861df5-8483-45b3-a161-bbf1ef2e676d service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:57.768256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb861df5-8483-45b3-a161-bbf1ef2e676d service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.860749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94f51-7924-44ca-8e5f-afeded4bf826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.861486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94f51-7924-44ca-8e5f-afeded4bf826 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.861773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94f51-7924-44ca-8e5f-afeded4bf826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.862054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94f51-7924-44ca-8e5f-afeded4bf826 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.867145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94f51-7924-44ca-8e5f-afeded4bf826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.870054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94f51-7924-44ca-8e5f-afeded4bf826 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:57.936777 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 895/1791] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:57 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:57.941592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875168bd-00f8-41f6-a062-6f38894b00a3 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:57.959560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875168bd-00f8-41f6-a062-6f38894b00a3 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:57.989070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb1c9-ae66-4b69-9cf6-d79166ce3a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:57.990066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb1c9-ae66-4b69-9cf6-d79166ce3a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.990530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb1c9-ae66-4b69-9cf6-d79166ce3a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.990872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb1c9-ae66-4b69-9cf6-d79166ce3a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.991738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eb1c9-ae66-4b69-9cf6-d79166ce3a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:57.995640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eb1c9-ae66-4b69-9cf6-d79166ce3a71 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.021478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 897/1792] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:58.030610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94f51-7924-44ca-8e5f-afeded4bf826 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.049246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94f51-7924-44ca-8e5f-afeded4bf826 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.056835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.057856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.063903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.066225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] PATH_INFO: `/v3/projects/235f5b30a4824ab8a51e028623a08e99/users/5e600b98de8d4c02bb1a4cc76fbafb6b/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.083122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:58.090469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235f5b30a4824ab8a51e028623a08e99, user_id=5e600b98de8d4c02bb1a4cc76fbafb6b, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.093053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.125536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 896/1793] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:58 2022] PUT /identity/v3/projects/235f5b30a4824ab8a51e028623a08e99/users/5e600b98de8d4c02bb1a4cc76fbafb6b/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:58.126426 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb1c9-ae66-4b69-9cf6-d79166ce3a71 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.126556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.130497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:58.150149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb1c9-ae66-4b69-9cf6-d79166ce3a71 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.201522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:58.230159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595e0e7-2a6f-4268-858d-23a6635f8415 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.235513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.236395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.236683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.236960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] PATH_INFO: `/v3/projects/836cafb9b5c04d5489e692f0445cc39c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.238266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=836cafb9b5c04d5489e692f0445cc39c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.240230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.305403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25171b-49a7-4740-8c98-3cb696361e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.306533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25171b-49a7-4740-8c98-3cb696361e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.306861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25171b-49a7-4740-8c98-3cb696361e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.307150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25171b-49a7-4740-8c98-3cb696361e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.308087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25171b-49a7-4740-8c98-3cb696361e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.309172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836cafb9b5c04d5489e692f0445cc39c', 'request_id': 'req-2383ee40-696f-4034-9d7a-91f58a6926cc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:58.309935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25171b-49a7-4740-8c98-3cb696361e16 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.321212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836cafb9b5c04d5489e692f0445cc39c', 'request_id': 'req-2383ee40-696f-4034-9d7a-91f58a6926cc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:58.322914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 898/1794] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:33:58.329064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25171b-49a7-4740-8c98-3cb696361e16 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.332719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836cafb9b5c04d5489e692f0445cc39c', 'request_id': 'req-2383ee40-696f-4034-9d7a-91f58a6926cc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:58.343811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25171b-49a7-4740-8c98-3cb696361e16 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.349937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] The token cache is being invalidate because project 836cafb9b5c04d5489e692f0445cc39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:33:58.350232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:58.350971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2383ee40-696f-4034-9d7a-91f58a6926cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:58.354571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 897/1795] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:33:58 2022] DELETE /identity/v3/projects/836cafb9b5c04d5489e692f0445cc39c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:58.360090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6872-1c0d-45ad-a775-96af5ad9f57e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.360473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6872-1c0d-45ad-a775-96af5ad9f57e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.360827 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6872-1c0d-45ad-a775-96af5ad9f57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.387064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e79b6872-1c0d-45ad-a775-96af5ad9f57e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:58.388542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e79b6872-1c0d-45ad-a775-96af5ad9f57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:58.440991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dfefa-892d-4a75-9022-0de98e1a4f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.442030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dfefa-892d-4a75-9022-0de98e1a4f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.442386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dfefa-892d-4a75-9022-0de98e1a4f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.443149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dfefa-892d-4a75-9022-0de98e1a4f7c admin admin] PATH_INFO: `/v3/projects/235f5b30a4824ab8a51e028623a08e99/users/5e600b98de8d4c02bb1a4cc76fbafb6b/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.447623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dfefa-892d-4a75-9022-0de98e1a4f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=235f5b30a4824ab8a51e028623a08e99, user_id=5e600b98de8d4c02bb1a4cc76fbafb6b, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.450989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dfefa-892d-4a75-9022-0de98e1a4f7c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.468408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 899/1796] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:58 2022] PUT /identity/v3/projects/235f5b30a4824ab8a51e028623a08e99/users/5e600b98de8d4c02bb1a4cc76fbafb6b/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:58.478505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492dee-386c-4e54-8029-e1f8c5ae3e51 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.482927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492dee-386c-4e54-8029-e1f8c5ae3e51 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.482927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70492dee-386c-4e54-8029-e1f8c5ae3e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.501916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 898/1797] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:58.509816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bfc21-b08f-47d9-b25d-565d92c4c75c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.510110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bfc21-b08f-47d9-b25d-565d92c4c75c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.510387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bfc21-b08f-47d9-b25d-565d92c4c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.526243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-70492dee-386c-4e54-8029-e1f8c5ae3e51 None None] MFA Rules not processed for user `5e600b98de8d4c02bb1a4cc76fbafb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:58.527844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-70492dee-386c-4e54-8029-e1f8c5ae3e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:58.530630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-310bfc21-b08f-47d9-b25d-565d92c4c75c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:58.532415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-310bfc21-b08f-47d9-b25d-565d92c4c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:58.546807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:58.598311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 899/1798] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:58.602944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bfc21-b08f-47d9-b25d-565d92c4c75c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.612601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bfc21-b08f-47d9-b25d-565d92c4c75c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.617296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 900/1799] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:58.625391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.625933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.626298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.626662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.627510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:33:58.627900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.628501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70492dee-386c-4e54-8029-e1f8c5ae3e51 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.629670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.629909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-70492dee-386c-4e54-8029-e1f8c5ae3e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:58.646011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 900/1800] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:33:58.651523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.664088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaefd7-4a8e-4a2a-8219-14dee9a0570f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.669484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f4ee-aefd-4aff-8b63-afac000032a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.673471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f4ee-aefd-4aff-8b63-afac000032a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.673849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f4ee-aefd-4aff-8b63-afac000032a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.674263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f4ee-aefd-4aff-8b63-afac000032a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.675344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f4ee-aefd-4aff-8b63-afac000032a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.677150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f4ee-aefd-4aff-8b63-afac000032a9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.680478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:58.703700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70492dee-386c-4e54-8029-e1f8c5ae3e51 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.708053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216223-efa5-4036-b6f9-fdb91b7bb967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.708723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216223-efa5-4036-b6f9-fdb91b7bb967 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.709010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216223-efa5-4036-b6f9-fdb91b7bb967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.709292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216223-efa5-4036-b6f9-fdb91b7bb967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.717884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 901/1801] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:33:58 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:33:58.720606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d216223-efa5-4036-b6f9-fdb91b7bb967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.721986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f4ee-aefd-4aff-8b63-afac000032a9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.723227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d216223-efa5-4036-b6f9-fdb91b7bb967 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.738074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 901/1802] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:58.836716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f4ee-aefd-4aff-8b63-afac000032a9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.846011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d8c3e-2b9f-416f-992d-92359cf3e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.846721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d8c3e-2b9f-416f-992d-92359cf3e362 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.847042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d8c3e-2b9f-416f-992d-92359cf3e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.847323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d8c3e-2b9f-416f-992d-92359cf3e362 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.848536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d8c3e-2b9f-416f-992d-92359cf3e362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.850470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d8c3e-2b9f-416f-992d-92359cf3e362 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.880918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 902/1803] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:33:58 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:33:58.885480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216223-efa5-4036-b6f9-fdb91b7bb967 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.898996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216223-efa5-4036-b6f9-fdb91b7bb967 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.904844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a40ca-aaad-4ed5-bbce-687d9f6e6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.905541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a40ca-aaad-4ed5-bbce-687d9f6e6d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.906360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a40ca-aaad-4ed5-bbce-687d9f6e6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.906649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a40ca-aaad-4ed5-bbce-687d9f6e6d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.907439 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a40ca-aaad-4ed5-bbce-687d9f6e6d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.910158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a40ca-aaad-4ed5-bbce-687d9f6e6d75 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.928078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 902/1804] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:58.929742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d8c3e-2b9f-416f-992d-92359cf3e362 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.941413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d8c3e-2b9f-416f-992d-92359cf3e362 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.949725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee3eed-ece8-4139-9d61-6a7fc37e88f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.950645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3eed-ece8-4139-9d61-6a7fc37e88f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.951072 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3eed-ece8-4139-9d61-6a7fc37e88f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.951395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3eed-ece8-4139-9d61-6a7fc37e88f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.952440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee3eed-ece8-4139-9d61-6a7fc37e88f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.962860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee3eed-ece8-4139-9d61-6a7fc37e88f8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.970614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 903/1805] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:33:58.973427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a40ca-aaad-4ed5-bbce-687d9f6e6d75 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:58.985511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a40ca-aaad-4ed5-bbce-687d9f6e6d75 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.990304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.991255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.991544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.991827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] PATH_INFO: `/v3/projects/569bc7b94531485ba71fdf204ea610f4/users/d384ce3e9f224a3abc30e6f5d6a03021/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.013245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569bc7b94531485ba71fdf204ea610f4, user_id=d384ce3e9f224a3abc30e6f5d6a03021, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:59.017291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:59.055388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 903/1806] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:33:58 2022] PUT /identity/v3/projects/569bc7b94531485ba71fdf204ea610f4/users/d384ce3e9f224a3abc30e6f5d6a03021/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:59.063299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc224c-6ce1-4d28-80af-22a6d62db1b0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.063600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc224c-6ce1-4d28-80af-22a6d62db1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.067197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc224c-6ce1-4d28-80af-22a6d62db1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.102380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c9dc224c-6ce1-4d28-80af-22a6d62db1b0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:59.105910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c9dc224c-6ce1-4d28-80af-22a6d62db1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:59.116801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:59.119115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:59.211197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 904/1807] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:59.223867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc224c-6ce1-4d28-80af-22a6d62db1b0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:59.226501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c9dc224c-6ce1-4d28-80af-22a6d62db1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:59.237162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:59.243089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67069-fdc0-4040-880f-a40643117601 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:59.257877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:59.258832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.259132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.259416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] PATH_INFO: `/v3/users/d26a45c9783448a9ab6deef8fdb5cd3a` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.260763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26a45c9783448a9ab6deef8fdb5cd3a)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:59.262728 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:59.331933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc224c-6ce1-4d28-80af-22a6d62db1b0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:59.337171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:59.338011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.338593 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.338965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.345938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26a45c9783448a9ab6deef8fdb5cd3a'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.351889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:59.354528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:59.368317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 905/1808] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:59.369283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:59.370702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:59.379783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26a45c9783448a9ab6deef8fdb5cd3a'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.382918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26a45c9783448a9ab6deef8fdb5cd3a'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.391514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f3ac-ce2f-42af-932c-e98fded8baaf service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:59.397210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26a45c9783448a9ab6deef8fdb5cd3a'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.400317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:59.402479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.402915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.403719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] PATH_INFO: `/v3/users/9b3c334f7c294da6a4d2563ef3da8361` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.405274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3c334f7c294da6a4d2563ef3da8361)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:59.407901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:59.411215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-60f1d841-266b-4991-8e1d-ae380a5eda29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26a45c9783448a9ab6deef8fdb5cd3a'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.428319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 904/1809] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:59 2022] DELETE /identity/v3/users/d26a45c9783448a9ab6deef8fdb5cd3a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:33:59.430547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46c1ed-d195-4685-ac1a-b834e235ab70 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.430980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46c1ed-d195-4685-ac1a-b834e235ab70 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.431778 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46c1ed-d195-4685-ac1a-b834e235ab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.461365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1c46c1ed-d195-4685-ac1a-b834e235ab70 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:59.463456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1c46c1ed-d195-4685-ac1a-b834e235ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:59.485363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:59.496926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3c334f7c294da6a4d2563ef3da8361'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.497708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3c334f7c294da6a4d2563ef3da8361'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.512417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3c334f7c294da6a4d2563ef3da8361'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.538450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3c334f7c294da6a4d2563ef3da8361'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.574997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3c334f7c294da6a4d2563ef3da8361'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:33:59.583450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 905/1810] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:59.600825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 906/1811] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:33:59 2022] DELETE /identity/v3/users/9b3c334f7c294da6a4d2563ef3da8361 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:33:59.605499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:59.606739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906a19d-1a8c-4141-88ab-ab64ad7f094c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.607755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:59.610220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906a19d-1a8c-4141-88ab-ab64ad7f094c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.610528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906a19d-1a8c-4141-88ab-ab64ad7f094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.655533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7906a19d-1a8c-4141-88ab-ab64ad7f094c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:59.656870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7906a19d-1a8c-4141-88ab-ab64ad7f094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:59.739694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4fbac-f8ef-4d27-bceb-ad76609f5c88 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:59.744067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ff9ac-7e00-4f8e-a42c-59da0922d38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:59.744757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ff9ac-7e00-4f8e-a42c-59da0922d38f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.745109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ff9ac-7e00-4f8e-a42c-59da0922d38f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.745447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ff9ac-7e00-4f8e-a42c-59da0922d38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.804828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:59.814259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 906/1812] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:59.839495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906a19d-1a8c-4141-88ab-ab64ad7f094c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:59.841136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7906a19d-1a8c-4141-88ab-ab64ad7f094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:59.867860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906a19d-1a8c-4141-88ab-ab64ad7f094c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:59.877644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ff9ac-7e00-4f8e-a42c-59da0922d38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:59.878708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:59.879466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.883658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ff9ac-7e00-4f8e-a42c-59da0922d38f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:59.884089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.884089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.907870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:59.913236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:59.922929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 907/1813] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:59.925510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933d6d7-043c-4c0c-b82c-773c2a5689aa None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.925834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933d6d7-043c-4c0c-b82c-773c2a5689aa None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.926258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933d6d7-043c-4c0c-b82c-773c2a5689aa None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:59.928125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 908/1814] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:33:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:59.929139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 907/1815] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:59.990642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9875f9-8dda-464b-a063-1633f7b025d6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:59.990958 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9875f9-8dda-464b-a063-1633f7b025d6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:59.991243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9875f9-8dda-464b-a063-1633f7b025d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:00.030702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7c9875f9-8dda-464b-a063-1633f7b025d6 None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:00.032014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7c9875f9-8dda-464b-a063-1633f7b025d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:00.154875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 909/1816] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:00.172216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:00.173962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:00.194959 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a0e7-dbe5-4780-80a4-a530f7124265 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:00.204617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0108419-0e8c-44e7-a2cd-26c1434c6599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:00.205692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0108419-0e8c-44e7-a2cd-26c1434c6599 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:00.205806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0108419-0e8c-44e7-a2cd-26c1434c6599 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:00.206178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0108419-0e8c-44e7-a2cd-26c1434c6599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:00.221807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0108419-0e8c-44e7-a2cd-26c1434c6599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:00.223798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0108419-0e8c-44e7-a2cd-26c1434c6599 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:00.246378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 908/1817] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:00.850219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9875f9-8dda-464b-a063-1633f7b025d6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:00.853360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7c9875f9-8dda-464b-a063-1633f7b025d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:00.875862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82823-75ff-4dc0-8bdc-bdd94b0df944 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:00.876385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82823-75ff-4dc0-8bdc-bdd94b0df944 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:00.876583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82823-75ff-4dc0-8bdc-bdd94b0df944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:00.887528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9875f9-8dda-464b-a063-1633f7b025d6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:00.899746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:00.900659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:00.900953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:00.901238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] PATH_INFO: `/v3/projects/b8daf651ef564eaba986e82ec715e381` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:00.907316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8daf651ef564eaba986e82ec715e381)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:00.911280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:00.945059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d1b82823-75ff-4dc0-8bdc-bdd94b0df944 None None] MFA Rules not processed for user `d384ce3e9f224a3abc30e6f5d6a03021`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:00.952381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d1b82823-75ff-4dc0-8bdc-bdd94b0df944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:01.085518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8daf651ef564eaba986e82ec715e381', 'request_id': 'req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.108976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8daf651ef564eaba986e82ec715e381', 'request_id': 'req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.116540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8daf651ef564eaba986e82ec715e381', 'request_id': 'req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.135365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 909/1818] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:01.144760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b82823-75ff-4dc0-8bdc-bdd94b0df944 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:01.156738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d1b82823-75ff-4dc0-8bdc-bdd94b0df944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:01.166793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] The token cache is being invalidate because project b8daf651ef564eaba986e82ec715e381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:01.167457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.170069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.179100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 910/1819] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:00 2022] DELETE /identity/v3/projects/b8daf651ef564eaba986e82ec715e381 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:01.193544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:01.197438 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:01.216224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b82823-75ff-4dc0-8bdc-bdd94b0df944 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:01.285283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:01.288891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:01.312981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7f65e-dfa4-4dce-993f-2ddeb70d21a3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:01.326362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:01.328220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:01.331346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:01.331856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] PATH_INFO: `/v3/users/5e600b98de8d4c02bb1a4cc76fbafb6b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:01.334679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e600b98de8d4c02bb1a4cc76fbafb6b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:01.337032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:01.371984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:01.372929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:01.373574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:01.374105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:01.375591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:01.378627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:01.441397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 910/1820] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:01 2022] POST /identity/v3/projects => generated 373 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:01.446285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:01.448919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:01.458519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e600b98de8d4c02bb1a4cc76fbafb6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.459389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e600b98de8d4c02bb1a4cc76fbafb6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.506275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e600b98de8d4c02bb1a4cc76fbafb6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.551842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e600b98de8d4c02bb1a4cc76fbafb6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.573563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737037-98f9-4013-a107-a922dd2441c4 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:01.581084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0bf17-60ce-4bb0-af13-4681f0b7df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:01.581817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bf17-60ce-4bb0-af13-4681f0b7df6b admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:01.582110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bf17-60ce-4bb0-af13-4681f0b7df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:01.582612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bf17-60ce-4bb0-af13-4681f0b7df6b admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:01.588230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0bf17-60ce-4bb0-af13-4681f0b7df6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:01.591418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0bf17-60ce-4bb0-af13-4681f0b7df6b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:01.609864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e600b98de8d4c02bb1a4cc76fbafb6b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:01.630013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 911/1821] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:01 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:01.633517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 911/1822] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:01 2022] DELETE /identity/v3/users/5e600b98de8d4c02bb1a4cc76fbafb6b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:01.633860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:01.638043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:01.787209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc04bf7-f614-4073-acb7-7719f1d92df0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:01.798961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:01.800995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:01.800995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:01.800995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:01.801273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:01.804432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:01.824912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 912/1823] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:01.828292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0bf17-60ce-4bb0-af13-4681f0b7df6b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:01.864445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0bf17-60ce-4bb0-af13-4681f0b7df6b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:01.875470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d7bfa-e132-4b2f-ae9c-c293fd8cdd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:01.878844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7bfa-e132-4b2f-ae9c-c293fd8cdd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:01.879473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7bfa-e132-4b2f-ae9c-c293fd8cdd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:01.879473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7bfa-e132-4b2f-ae9c-c293fd8cdd46 admin admin] PATH_INFO: `/v3/projects/99a9df3c7a794a23ba28e9fcc901d74d/users/62e5832db1774c88bbd83238fb216a11/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:01.890872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:01.893824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:01.925721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407fee0-6d0b-43c6-89ea-5dbafbdae4a2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:01.931085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d7bfa-e132-4b2f-ae9c-c293fd8cdd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a9df3c7a794a23ba28e9fcc901d74d, user_id=62e5832db1774c88bbd83238fb216a11, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:01.940473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d7bfa-e132-4b2f-ae9c-c293fd8cdd46 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:01.941228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:01.942700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:01.942994 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:01.943727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] PATH_INFO: `/v3/projects/9484b1922f154ccbabe36511f8556b26` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:01.946450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9484b1922f154ccbabe36511f8556b26)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:01.952110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:01.971392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 912/1824] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:01 2022] PUT /identity/v3/projects/99a9df3c7a794a23ba28e9fcc901d74d/users/62e5832db1774c88bbd83238fb216a11/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:01.974998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d7bfa-e132-4b2f-ae9c-c293fd8cdd46 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:02.106743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9484b1922f154ccbabe36511f8556b26', 'request_id': 'req-2f592966-fbea-43a2-91f4-4665c6ad9ae4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.122647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9484b1922f154ccbabe36511f8556b26', 'request_id': 'req-2f592966-fbea-43a2-91f4-4665c6ad9ae4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.124130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:02.141693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9484b1922f154ccbabe36511f8556b26', 'request_id': 'req-2f592966-fbea-43a2-91f4-4665c6ad9ae4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.169909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] The token cache is being invalidate because project 9484b1922f154ccbabe36511f8556b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:02.172519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.174582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.178821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 913/1825] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:01 2022] DELETE /identity/v3/projects/9484b1922f154ccbabe36511f8556b26 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:02.179162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d7bfa-e132-4b2f-ae9c-c293fd8cdd46 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:02.184220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:02.186737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:02.236177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:02.317477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:02.318190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:02.318480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:02.318763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:02.319531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:02.329889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:02.342188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592966-fbea-43a2-91f4-4665c6ad9ae4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:02.350257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 913/1826] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:02.353258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:02.354174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:02.354642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:02.354975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] PATH_INFO: `/v3/users/8f850504dc964682a73194559c07b827` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:02.356486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:02.357550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f850504dc964682a73194559c07b827)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:02.360128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:02.363308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:02.390080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82f6f9-d60f-499b-8885-7923e597e826 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:02.405607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:02.407086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:02.407381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:02.407661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] PATH_INFO: `/v3/projects/99a9df3c7a794a23ba28e9fcc901d74d/users/62e5832db1774c88bbd83238fb216a11/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:02.415117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a9df3c7a794a23ba28e9fcc901d74d, user_id=62e5832db1774c88bbd83238fb216a11, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:02.418507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:02.444124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 914/1827] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:02 2022] PUT /identity/v3/projects/99a9df3c7a794a23ba28e9fcc901d74d/users/62e5832db1774c88bbd83238fb216a11/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:02.445258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:02.471233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:02.492501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f850504dc964682a73194559c07b827'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.493384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f850504dc964682a73194559c07b827'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.518092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f850504dc964682a73194559c07b827'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.538536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f850504dc964682a73194559c07b827'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.570931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c03141b8-30ca-494f-984d-ec8ada74d2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f850504dc964682a73194559c07b827'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.584958 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 914/1828] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:02 2022] DELETE /identity/v3/users/8f850504dc964682a73194559c07b827 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:02.639966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6a21-6c6a-47b4-9c02-3442b79f8a12 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:02.737087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:02.738333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:02.739021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:02.740297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] PATH_INFO: `/v3/projects/235f5b30a4824ab8a51e028623a08e99` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:02.742047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] RBAC: Authorizing `identity:delete_project(project_id=235f5b30a4824ab8a51e028623a08e99)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:02.744456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:02.841062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235f5b30a4824ab8a51e028623a08e99', 'request_id': 'req-22eda1e6-8ae5-457e-be45-a849225f310f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.853414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:02.855885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235f5b30a4824ab8a51e028623a08e99', 'request_id': 'req-22eda1e6-8ae5-457e-be45-a849225f310f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.864685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235f5b30a4824ab8a51e028623a08e99', 'request_id': 'req-22eda1e6-8ae5-457e-be45-a849225f310f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.891877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] The token cache is being invalidate because project 235f5b30a4824ab8a51e028623a08e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:02.892537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.893877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-22eda1e6-8ae5-457e-be45-a849225f310f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:02.896107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 915/1829] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:02 2022] DELETE /identity/v3/projects/235f5b30a4824ab8a51e028623a08e99 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:02.902238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12ced-045a-494b-9fe3-69fe64ac842a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:02.903069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12ced-045a-494b-9fe3-69fe64ac842a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:02.903529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12ced-045a-494b-9fe3-69fe64ac842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:02.939401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-88e12ced-045a-494b-9fe3-69fe64ac842a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:02.945477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-88e12ced-045a-494b-9fe3-69fe64ac842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:03.041080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 915/1830] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:03.045347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abe37b-7139-402b-a760-61b9841a4d9d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.045648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abe37b-7139-402b-a760-61b9841a4d9d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.045936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abe37b-7139-402b-a760-61b9841a4d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.073716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d7abe37b-7139-402b-a760-61b9841a4d9d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:03.075356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d7abe37b-7139-402b-a760-61b9841a4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:03.086964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 916/1831] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:03.090829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12ced-045a-494b-9fe3-69fe64ac842a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:03.100788 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:03.109813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12ced-045a-494b-9fe3-69fe64ac842a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:03.117255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:03.118146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.132712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.133173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.137186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:03.138153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:03.150414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:03.179312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 916/1832] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:34:03.189424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abe37b-7139-402b-a760-61b9841a4d9d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:03.227228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abe37b-7139-402b-a760-61b9841a4d9d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:03.233365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f7394-3c42-43f4-bc2f-2dd08aea4933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:03.235228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f7394-3c42-43f4-bc2f-2dd08aea4933 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.235611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f7394-3c42-43f4-bc2f-2dd08aea4933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.235966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f7394-3c42-43f4-bc2f-2dd08aea4933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.236746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f7394-3c42-43f4-bc2f-2dd08aea4933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:03.242537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f7394-3c42-43f4-bc2f-2dd08aea4933 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:03.287153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 917/1833] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:03 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:03.288757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:03.324797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49e42f-aa7b-4224-aca5-5f8b53100020 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:03.455261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227d1b-d987-4624-8ebd-b1d9d88b2921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:03.455983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227d1b-d987-4624-8ebd-b1d9d88b2921 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.456270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227d1b-d987-4624-8ebd-b1d9d88b2921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.456563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227d1b-d987-4624-8ebd-b1d9d88b2921 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.457554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227d1b-d987-4624-8ebd-b1d9d88b2921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:03.459872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227d1b-d987-4624-8ebd-b1d9d88b2921 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:03.483183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 917/1834] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:03 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:03.486703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f7394-3c42-43f4-bc2f-2dd08aea4933 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:03.496919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f7394-3c42-43f4-bc2f-2dd08aea4933 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:03.502091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ec1e0-cacf-47d1-845d-d60f23d09a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:03.502881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ec1e0-cacf-47d1-845d-d60f23d09a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.503625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ec1e0-cacf-47d1-845d-d60f23d09a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.503625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ec1e0-cacf-47d1-845d-d60f23d09a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.504696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ec1e0-cacf-47d1-845d-d60f23d09a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:03.507300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ec1e0-cacf-47d1-845d-d60f23d09a5d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:03.520004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 918/1835] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:03.524023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227d1b-d987-4624-8ebd-b1d9d88b2921 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:03.538641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227d1b-d987-4624-8ebd-b1d9d88b2921 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:03.566305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca22a6-6e6d-47c7-b167-d1b55f6217cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:03.566981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca22a6-6e6d-47c7-b167-d1b55f6217cc admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.567369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca22a6-6e6d-47c7-b167-d1b55f6217cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.567652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca22a6-6e6d-47c7-b167-d1b55f6217cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.568535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca22a6-6e6d-47c7-b167-d1b55f6217cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:03.570437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca22a6-6e6d-47c7-b167-d1b55f6217cc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:03.584938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 918/1836] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:03.589327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ec1e0-cacf-47d1-845d-d60f23d09a5d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:03.606496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ec1e0-cacf-47d1-845d-d60f23d09a5d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:03.634740 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:03.641699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.644757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.645267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] PATH_INFO: `/v3/projects/b35930abd60a4b828a38df347ac2bc9e/users/fddc22c9952645dd8b272175d85a96b8/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.688951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35930abd60a4b828a38df347ac2bc9e, user_id=fddc22c9952645dd8b272175d85a96b8, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:03.693437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:03.733540 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 919/1837] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:03 2022] PUT /identity/v3/projects/b35930abd60a4b828a38df347ac2bc9e/users/fddc22c9952645dd8b272175d85a96b8/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:03.737612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aec31-33c8-4a59-9008-afb703296fc0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.737612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aec31-33c8-4a59-9008-afb703296fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.737612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aec31-33c8-4a59-9008-afb703296fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.761526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:03.763936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:03.811782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fb5aec31-33c8-4a59-9008-afb703296fc0 None None] MFA Rules not processed for user `fddc22c9952645dd8b272175d85a96b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:03.814729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fb5aec31-33c8-4a59-9008-afb703296fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:03.939862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fc8a8-a93b-454b-be17-ef2cc25be2fd admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:03.955788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:03.956704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:03.957046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:03.957332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] PATH_INFO: `/v3/projects/f74ccb5d945841ef9e7289028706e693` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:03.959506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74ccb5d945841ef9e7289028706e693)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:03.965921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:03.998527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 919/1838] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:04.001188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74294-ffce-4e62-98b0-fdf2f761ec54 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.001671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74294-ffce-4e62-98b0-fdf2f761ec54 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.001968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74294-ffce-4e62-98b0-fdf2f761ec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.039257 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-25b74294-ffce-4e62-98b0-fdf2f761ec54 None None] MFA Rules not processed for user `62e5832db1774c88bbd83238fb216a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:04.040482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-25b74294-ffce-4e62-98b0-fdf2f761ec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:04.088418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74ccb5d945841ef9e7289028706e693', 'request_id': 'req-dcda28cd-63c5-4e70-9674-92f34166aa4f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:04.097661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74ccb5d945841ef9e7289028706e693', 'request_id': 'req-dcda28cd-63c5-4e70-9674-92f34166aa4f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:04.107262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74ccb5d945841ef9e7289028706e693', 'request_id': 'req-dcda28cd-63c5-4e70-9674-92f34166aa4f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:04.107906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:04.130909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] The token cache is being invalidate because project f74ccb5d945841ef9e7289028706e693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:04.131790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:04.132234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:04.137583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 920/1839] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:03 2022] DELETE /identity/v3/projects/f74ccb5d945841ef9e7289028706e693 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:04.137583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.137855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:04.150659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 920/1840] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:04.152463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d6cb4-88d1-4e33-9064-dd579b12fe79 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.153105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d6cb4-88d1-4e33-9064-dd579b12fe79 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.153557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d6cb4-88d1-4e33-9064-dd579b12fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.162110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:04.181720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-785d6cb4-88d1-4e33-9064-dd579b12fe79 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:04.183206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-785d6cb4-88d1-4e33-9064-dd579b12fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:04.296112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 921/1841] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:04.300940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8cc3-190f-41fe-b97e-89b01a86b5c5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.301317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8cc3-190f-41fe-b97e-89b01a86b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.304153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8cc3-190f-41fe-b97e-89b01a86b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.307264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda28cd-63c5-4e70-9674-92f34166aa4f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.321614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0de3c-bd9a-4451-8990-dbdd7ab034a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.322891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0de3c-bd9a-4451-8990-dbdd7ab034a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.323433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0de3c-bd9a-4451-8990-dbdd7ab034a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.324241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0de3c-bd9a-4451-8990-dbdd7ab034a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.325260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0de3c-bd9a-4451-8990-dbdd7ab034a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.325550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f10e8cc3-190f-41fe-b97e-89b01a86b5c5 None None] MFA Rules not processed for user `d384ce3e9f224a3abc30e6f5d6a03021`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:04.327445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f10e8cc3-190f-41fe-b97e-89b01a86b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:04.334131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0de3c-bd9a-4451-8990-dbdd7ab034a6 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.390974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 921/1842] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:04 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:04.390974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78269-05b9-4a0f-a5bf-6355521a2622 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.390974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78269-05b9-4a0f-a5bf-6355521a2622 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.390974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d78269-05b9-4a0f-a5bf-6355521a2622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.411506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 922/1843] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:04.411506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e8cc3-190f-41fe-b97e-89b01a86b5c5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.419401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-92d78269-05b9-4a0f-a5bf-6355521a2622 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:04.421087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-92d78269-05b9-4a0f-a5bf-6355521a2622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:04.426972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e8cc3-190f-41fe-b97e-89b01a86b5c5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.501747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318b995-3635-4798-93f4-f549a0766b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.503074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318b995-3635-4798-93f4-f549a0766b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.503686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318b995-3635-4798-93f4-f549a0766b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.504161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318b995-3635-4798-93f4-f549a0766b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.505215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318b995-3635-4798-93f4-f549a0766b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.507863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318b995-3635-4798-93f4-f549a0766b4d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.509365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 922/1844] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:04.519887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d78269-05b9-4a0f-a5bf-6355521a2622 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.531403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d78269-05b9-4a0f-a5bf-6355521a2622 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.536888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.537576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.537889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.538303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.544051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:04.544377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 923/1845] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:04 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:04.544679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.547106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.548803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318b995-3635-4798-93f4-f549a0766b4d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.559709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318b995-3635-4798-93f4-f549a0766b4d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.560465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 923/1846] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:04.566060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.566412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993edf4-de09-48b7-9b32-b731f2aac42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.567103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993edf4-de09-48b7-9b32-b731f2aac42d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.567425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993edf4-de09-48b7-9b32-b731f2aac42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.567726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993edf4-de09-48b7-9b32-b731f2aac42d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.568484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993edf4-de09-48b7-9b32-b731f2aac42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.570289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993edf4-de09-48b7-9b32-b731f2aac42d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.581078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147e556-f00f-464f-b3ec-e4717fd4492f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.584921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 924/1847] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:04.586354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993edf4-de09-48b7-9b32-b731f2aac42d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.595217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2f15-419a-4964-9e59-adeace7211ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.595901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2f15-419a-4964-9e59-adeace7211ec admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.596191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2f15-419a-4964-9e59-adeace7211ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.596492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2f15-419a-4964-9e59-adeace7211ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.597190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a2f15-419a-4964-9e59-adeace7211ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.598027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993edf4-de09-48b7-9b32-b731f2aac42d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.599384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a2f15-419a-4964-9e59-adeace7211ec admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.605970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e3fcc-3777-4904-867f-a8b2b42d0525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.605970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e3fcc-3777-4904-867f-a8b2b42d0525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.605970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e3fcc-3777-4904-867f-a8b2b42d0525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.605970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e3fcc-3777-4904-867f-a8b2b42d0525 admin admin] PATH_INFO: `/v3/projects/2c0876b978a04718a31484d6406e80f2/users/42f438af5f704572afd1ee32df7f6aa6/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.608561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:04.626586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e3fcc-3777-4904-867f-a8b2b42d0525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0876b978a04718a31484d6406e80f2, user_id=42f438af5f704572afd1ee32df7f6aa6, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.629040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e3fcc-3777-4904-867f-a8b2b42d0525 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.639645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 924/1848] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:04 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:04.640616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2f15-419a-4964-9e59-adeace7211ec admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.652638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 925/1849] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:04 2022] PUT /identity/v3/projects/2c0876b978a04718a31484d6406e80f2/users/42f438af5f704572afd1ee32df7f6aa6/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:04.653674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e3fcc-3777-4904-867f-a8b2b42d0525 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.722144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2f15-419a-4964-9e59-adeace7211ec admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.730849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:04.752628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e3fcc-3777-4904-867f-a8b2b42d0525 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.752628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.752628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.752628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.753030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.753030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.754022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.769816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 926/1850] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:04.770040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.771811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:04.795635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d61e5-295b-4e1a-93be-c672747b2e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.797045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d61e5-295b-4e1a-93be-c672747b2e2e admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.797307 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d61e5-295b-4e1a-93be-c672747b2e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.797613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d61e5-295b-4e1a-93be-c672747b2e2e admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.798318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d61e5-295b-4e1a-93be-c672747b2e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.800364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d61e5-295b-4e1a-93be-c672747b2e2e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.830449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 925/1851] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:04 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:04.831491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d61e5-295b-4e1a-93be-c672747b2e2e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.844717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d61e5-295b-4e1a-93be-c672747b2e2e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.850714 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87715b-c4ac-4487-8a75-fb963e509782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.851767 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87715b-c4ac-4487-8a75-fb963e509782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.852591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87715b-c4ac-4487-8a75-fb963e509782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.852879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87715b-c4ac-4487-8a75-fb963e509782 admin admin] PATH_INFO: `/v3/projects/2c0876b978a04718a31484d6406e80f2/users/42f438af5f704572afd1ee32df7f6aa6/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.854931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87715b-c4ac-4487-8a75-fb963e509782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0876b978a04718a31484d6406e80f2, user_id=42f438af5f704572afd1ee32df7f6aa6, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.858187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87715b-c4ac-4487-8a75-fb963e509782 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.870603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118132b-7b85-48dc-bdc6-aecaddfeb021 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.877019 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 926/1852] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:04 2022] PUT /identity/v3/projects/2c0876b978a04718a31484d6406e80f2/users/42f438af5f704572afd1ee32df7f6aa6/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:04.878963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87715b-c4ac-4487-8a75-fb963e509782 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:04.950151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.950836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.951127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.951405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.953855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:04.964448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87715b-c4ac-4487-8a75-fb963e509782 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:04.967502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:04.973425 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6743f45-01a1-4065-8065-b53f8089ae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:04.974992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6743f45-01a1-4065-8065-b53f8089ae36 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.975389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6743f45-01a1-4065-8065-b53f8089ae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.975571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6743f45-01a1-4065-8065-b53f8089ae36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:04.976570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6743f45-01a1-4065-8065-b53f8089ae36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:04.978358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6743f45-01a1-4065-8065-b53f8089ae36 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:04.993365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 927/1853] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:04.994857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7f065-cf89-4ced-aacb-310982fab09d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:04.995231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7f065-cf89-4ced-aacb-310982fab09d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:04.995530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7f065-cf89-4ced-aacb-310982fab09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.026526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-00c7f065-cf89-4ced-aacb-310982fab09d None None] MFA Rules not processed for user `42f438af5f704572afd1ee32df7f6aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:05.027940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-00c7f065-cf89-4ced-aacb-310982fab09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:05.032819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:05.034739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:05.058614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 927/1854] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:05.059636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:05.079578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafd8a2-1016-47e3-8ed2-13550ee605db service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:05.086276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05962cfe-6348-4d40-a340-06332a2161ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:05.087261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962cfe-6348-4d40-a340-06332a2161ae admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:05.087731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962cfe-6348-4d40-a340-06332a2161ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:05.088190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962cfe-6348-4d40-a340-06332a2161ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.089153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05962cfe-6348-4d40-a340-06332a2161ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:05.091964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05962cfe-6348-4d40-a340-06332a2161ae admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:05.110803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 928/1855] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:05.116684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05962cfe-6348-4d40-a340-06332a2161ae admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:05.127837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05962cfe-6348-4d40-a340-06332a2161ae admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:05.132594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a6fc4-9b78-4f1c-918a-911c20cca2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:05.137730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a6fc4-9b78-4f1c-918a-911c20cca2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:05.138048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 928/1856] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:05.138287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a6fc4-9b78-4f1c-918a-911c20cca2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:05.138595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a6fc4-9b78-4f1c-918a-911c20cca2ce admin admin] PATH_INFO: `/v3/projects/60d1eec3992e4915aa0078470d30419a/users/bcf76d9d31c04f8fa827460dfd02a364/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.160425 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7f065-cf89-4ced-aacb-310982fab09d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:05.163424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-00c7f065-cf89-4ced-aacb-310982fab09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:05.179050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a6fc4-9b78-4f1c-918a-911c20cca2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d1eec3992e4915aa0078470d30419a, user_id=bcf76d9d31c04f8fa827460dfd02a364, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:05.179873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:05.182648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a6fc4-9b78-4f1c-918a-911c20cca2ce admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:05.198434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 929/1857] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:05 2022] PUT /identity/v3/projects/60d1eec3992e4915aa0078470d30419a/users/bcf76d9d31c04f8fa827460dfd02a364/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:05.209466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7d63-dec3-4a4f-8672-0be157e859f8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:05.209762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7d63-dec3-4a4f-8672-0be157e859f8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:05.210047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7d63-dec3-4a4f-8672-0be157e859f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.239249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e4cd7d63-dec3-4a4f-8672-0be157e859f8 None None] MFA Rules not processed for user `bcf76d9d31c04f8fa827460dfd02a364`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:05.240477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e4cd7d63-dec3-4a4f-8672-0be157e859f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:05.247287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7f065-cf89-4ced-aacb-310982fab09d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:05.313815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:05.314679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:05.315090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:05.315469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.317805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:05.344845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 930/1858] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:05.350075 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd7d63-dec3-4a4f-8672-0be157e859f8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:05.403281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:05.404781 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:05.415011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 929/1859] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:05.427028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd7d63-dec3-4a4f-8672-0be157e859f8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:05.431923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d67c0-a12e-41d3-b66a-2fcd87f3d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:05.432663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d67c0-a12e-41d3-b66a-2fcd87f3d88b admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:05.433102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d67c0-a12e-41d3-b66a-2fcd87f3d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:05.433393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d67c0-a12e-41d3-b66a-2fcd87f3d88b admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.434094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d67c0-a12e-41d3-b66a-2fcd87f3d88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:05.436270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d67c0-a12e-41d3-b66a-2fcd87f3d88b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:05.450355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:05.472543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 931/1860] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:05 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:05.474285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:05.489846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb5e1f-a066-407f-b32b-124bc133e9da service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:05.598687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff0e23-1b73-4fdd-9322-b74923c0b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:05.599498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff0e23-1b73-4fdd-9322-b74923c0b209 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:05.599804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff0e23-1b73-4fdd-9322-b74923c0b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:05.601500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff0e23-1b73-4fdd-9322-b74923c0b209 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.602297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff0e23-1b73-4fdd-9322-b74923c0b209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:05.605954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff0e23-1b73-4fdd-9322-b74923c0b209 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:05.649917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 930/1861] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:05 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:05.651542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d67c0-a12e-41d3-b66a-2fcd87f3d88b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:05.669767 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d67c0-a12e-41d3-b66a-2fcd87f3d88b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:05.677000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99e38e-b5e7-4dbe-b9d0-0bb49259b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:05.678393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99e38e-b5e7-4dbe-b9d0-0bb49259b851 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:05.678755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99e38e-b5e7-4dbe-b9d0-0bb49259b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:05.679509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99e38e-b5e7-4dbe-b9d0-0bb49259b851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.680996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99e38e-b5e7-4dbe-b9d0-0bb49259b851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:05.682376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99e38e-b5e7-4dbe-b9d0-0bb49259b851 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:05.695569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 932/1862] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:05.699993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff0e23-1b73-4fdd-9322-b74923c0b209 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:05.713507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff0e23-1b73-4fdd-9322-b74923c0b209 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:05.729451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb45db-1817-450d-b972-f8c0f6395739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:05.730369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb45db-1817-450d-b972-f8c0f6395739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:05.730680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb45db-1817-450d-b972-f8c0f6395739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:05.730972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb45db-1817-450d-b972-f8c0f6395739 admin admin] PATH_INFO: `/v3/projects/85838b7cf52d4d7ea361356d64506c54/users/e05fd2ee773846e0aae0789f500809b4/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:05.734663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:05.772100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb45db-1817-450d-b972-f8c0f6395739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85838b7cf52d4d7ea361356d64506c54, user_id=e05fd2ee773846e0aae0789f500809b4, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:05.775855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb45db-1817-450d-b972-f8c0f6395739 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:05.811890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 931/1863] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:05 2022] PUT /identity/v3/projects/85838b7cf52d4d7ea361356d64506c54/users/e05fd2ee773846e0aae0789f500809b4/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:05.816395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99e38e-b5e7-4dbe-b9d0-0bb49259b851 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:05.840901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99e38e-b5e7-4dbe-b9d0-0bb49259b851 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:06.046854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b43753-607c-45c1-b304-73237951f673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:06.046854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43753-607c-45c1-b304-73237951f673 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:06.046854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43753-607c-45c1-b304-73237951f673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:06.046854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43753-607c-45c1-b304-73237951f673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:06.047667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b43753-607c-45c1-b304-73237951f673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:06.048827 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b43753-607c-45c1-b304-73237951f673 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:06.077417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 933/1864] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:06.082042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb45db-1817-450d-b972-f8c0f6395739 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:06.093497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb45db-1817-450d-b972-f8c0f6395739 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:06.115226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:06.116146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:06.116791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:06.117075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] PATH_INFO: `/v3/projects/85838b7cf52d4d7ea361356d64506c54/users/e05fd2ee773846e0aae0789f500809b4/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:06.123304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=85838b7cf52d4d7ea361356d64506c54, user_id=e05fd2ee773846e0aae0789f500809b4, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:06.130154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:06.175363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 932/1865] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:06 2022] PUT /identity/v3/projects/85838b7cf52d4d7ea361356d64506c54/users/e05fd2ee773846e0aae0789f500809b4/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:06.179414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194aa9f-9ad8-43e1-8ac7-6bfcc7185d07 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:06.179714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194aa9f-9ad8-43e1-8ac7-6bfcc7185d07 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:06.180003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194aa9f-9ad8-43e1-8ac7-6bfcc7185d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:06.223688 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1194aa9f-9ad8-43e1-8ac7-6bfcc7185d07 None None] MFA Rules not processed for user `e05fd2ee773846e0aae0789f500809b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:06.225080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1194aa9f-9ad8-43e1-8ac7-6bfcc7185d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:06.324512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 934/1866] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:06.350288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:06.351675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:06.455544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a015bf0-6cc6-40df-bcf9-bf9753e53d2f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:06.460414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a87102-96b9-4e5e-af42-b44753d6a326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:06.461078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a87102-96b9-4e5e-af42-b44753d6a326 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:06.461364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a87102-96b9-4e5e-af42-b44753d6a326 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:06.461677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a87102-96b9-4e5e-af42-b44753d6a326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:06.472279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a87102-96b9-4e5e-af42-b44753d6a326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:06.474010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a87102-96b9-4e5e-af42-b44753d6a326 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:06.511152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 933/1867] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:06.959397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194aa9f-9ad8-43e1-8ac7-6bfcc7185d07 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:07.029521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194aa9f-9ad8-43e1-8ac7-6bfcc7185d07 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:07.035513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:07.036544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:07.036897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:07.037265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] PATH_INFO: `/v3/users/bcf76d9d31c04f8fa827460dfd02a364` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:07.038975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf76d9d31c04f8fa827460dfd02a364)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:07.042531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:07.049886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:07.116787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf76d9d31c04f8fa827460dfd02a364'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.117703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf76d9d31c04f8fa827460dfd02a364'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.127986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf76d9d31c04f8fa827460dfd02a364'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.136825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf76d9d31c04f8fa827460dfd02a364'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.150350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf76d9d31c04f8fa827460dfd02a364'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.158702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 935/1868] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:06 2022] DELETE /identity/v3/users/bcf76d9d31c04f8fa827460dfd02a364 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:07.163165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a71128-e9d6-4ff9-9dfe-31ec2f1f91ca None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:07.163611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a71128-e9d6-4ff9-9dfe-31ec2f1f91ca None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:07.163768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a71128-e9d6-4ff9-9dfe-31ec2f1f91ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:07.187041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-05a71128-e9d6-4ff9-9dfe-31ec2f1f91ca None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:07.188811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-05a71128-e9d6-4ff9-9dfe-31ec2f1f91ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:07.261278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 934/1869] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:07.276910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:07.278898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:07.357183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d358a4-9eb4-44e2-9ed4-574cbcecf6b1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:07.361194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9eccfb-6cfc-4332-bd48-765792ba0180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:07.361898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eccfb-6cfc-4332-bd48-765792ba0180 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:07.362185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eccfb-6cfc-4332-bd48-765792ba0180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:07.362494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9eccfb-6cfc-4332-bd48-765792ba0180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:07.372146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9eccfb-6cfc-4332-bd48-765792ba0180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:07.373655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9eccfb-6cfc-4332-bd48-765792ba0180 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:07.384834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 936/1870] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:07.761888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a71128-e9d6-4ff9-9dfe-31ec2f1f91ca None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:07.763493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-05a71128-e9d6-4ff9-9dfe-31ec2f1f91ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:07.777399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a71128-e9d6-4ff9-9dfe-31ec2f1f91ca None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:07.782487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:07.783655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:07.784478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:07.784478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] PATH_INFO: `/v3/projects/60d1eec3992e4915aa0078470d30419a` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:07.785470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d1eec3992e4915aa0078470d30419a)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:07.787507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:07.833893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d1eec3992e4915aa0078470d30419a', 'request_id': 'req-3782a4c7-0348-43ac-b980-ce1259a651a8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.839399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d1eec3992e4915aa0078470d30419a', 'request_id': 'req-3782a4c7-0348-43ac-b980-ce1259a651a8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.846059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d1eec3992e4915aa0078470d30419a', 'request_id': 'req-3782a4c7-0348-43ac-b980-ce1259a651a8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.849651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:07.862325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] The token cache is being invalidate because project 60d1eec3992e4915aa0078470d30419a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:07.862615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.863300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:07.864913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 935/1871] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:07 2022] DELETE /identity/v3/projects/60d1eec3992e4915aa0078470d30419a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:07.868848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9eccfb-6cfc-4332-bd48-765792ba0180 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:07.878938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9eccfb-6cfc-4332-bd48-765792ba0180 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:07.950062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:07.951117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:07.951473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:07.952017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] PATH_INFO: `/v3/users/e05fd2ee773846e0aae0789f500809b4` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:07.954904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05fd2ee773846e0aae0789f500809b4)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:07.957488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:07.993843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:08.013869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05fd2ee773846e0aae0789f500809b4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.014553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05fd2ee773846e0aae0789f500809b4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.022601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05fd2ee773846e0aae0789f500809b4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.029777 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05fd2ee773846e0aae0789f500809b4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.042967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-65392f3d-a178-42e1-81df-4f41248c732d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05fd2ee773846e0aae0789f500809b4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.049038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 937/1872] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:07 2022] DELETE /identity/v3/users/e05fd2ee773846e0aae0789f500809b4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:08.423021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:08.424459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:08.438218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782a4c7-0348-43ac-b980-ce1259a651a8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:08.510532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:08.511580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:08.511868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:08.512141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] PATH_INFO: `/v3/projects/85838b7cf52d4d7ea361356d64506c54` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:08.513459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85838b7cf52d4d7ea361356d64506c54)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:08.515649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:08.571523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85838b7cf52d4d7ea361356d64506c54', 'request_id': 'req-3a6f118a-f83a-4e45-aaba-7dc8ee153357'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.577337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85838b7cf52d4d7ea361356d64506c54', 'request_id': 'req-3a6f118a-f83a-4e45-aaba-7dc8ee153357'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.583953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85838b7cf52d4d7ea361356d64506c54', 'request_id': 'req-3a6f118a-f83a-4e45-aaba-7dc8ee153357'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.597129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] The token cache is being invalidate because project 85838b7cf52d4d7ea361356d64506c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:08.597610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.598265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3a6f118a-f83a-4e45-aaba-7dc8ee153357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:08.599838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 936/1873] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:08 2022] DELETE /identity/v3/projects/85838b7cf52d4d7ea361356d64506c54 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:08.604726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6e43-91dd-4f20-9930-54f9a88dc8d8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:08.605169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6e43-91dd-4f20-9930-54f9a88dc8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:08.605288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6e43-91dd-4f20-9930-54f9a88dc8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:08.623993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-162b6e43-91dd-4f20-9930-54f9a88dc8d8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:08.625219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-162b6e43-91dd-4f20-9930-54f9a88dc8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:08.689104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 938/1874] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:08.696886 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942ae9-e6ec-432e-8cb7-17ff5ae51693 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:08.697189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942ae9-e6ec-432e-8cb7-17ff5ae51693 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:08.697472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942ae9-e6ec-432e-8cb7-17ff5ae51693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:08.723308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-cb942ae9-e6ec-432e-8cb7-17ff5ae51693 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:08.724536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-cb942ae9-e6ec-432e-8cb7-17ff5ae51693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:08.732817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 937/1875] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:08.737573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b6e43-91dd-4f20-9930-54f9a88dc8d8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:08.747758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b6e43-91dd-4f20-9930-54f9a88dc8d8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:08.752345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:08.753014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:08.753311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:08.753601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:08.754698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:08.755091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:08.757129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:08.787780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 939/1876] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:08.792086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942ae9-e6ec-432e-8cb7-17ff5ae51693 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:08.806238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942ae9-e6ec-432e-8cb7-17ff5ae51693 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:08.814497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea75e5-4423-48ea-97b0-0f96499a377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:08.816006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea75e5-4423-48ea-97b0-0f96499a377a admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:08.816300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea75e5-4423-48ea-97b0-0f96499a377a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:08.816625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea75e5-4423-48ea-97b0-0f96499a377a admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:08.817646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea75e5-4423-48ea-97b0-0f96499a377a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:08.820447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea75e5-4423-48ea-97b0-0f96499a377a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:08.867345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:08.876539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 938/1877] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:08 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:08.880652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400db37-3006-4da3-b228-8315cb73b5a7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:08.954455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42227b83-d81d-4d44-a17d-6aa926a43eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:08.955173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227b83-d81d-4d44-a17d-6aa926a43eff admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:08.955461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227b83-d81d-4d44-a17d-6aa926a43eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:08.955745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227b83-d81d-4d44-a17d-6aa926a43eff admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:08.956437 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42227b83-d81d-4d44-a17d-6aa926a43eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:08.958346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42227b83-d81d-4d44-a17d-6aa926a43eff admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:08.979887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 940/1878] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:08 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:08.984080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea75e5-4423-48ea-97b0-0f96499a377a admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:08.996410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea75e5-4423-48ea-97b0-0f96499a377a admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.002809 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6ac9a-4ccd-4ee4-b302-bf928ec432b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.003413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ac9a-4ccd-4ee4-b302-bf928ec432b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.003661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ac9a-4ccd-4ee4-b302-bf928ec432b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.003942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ac9a-4ccd-4ee4-b302-bf928ec432b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.004712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6ac9a-4ccd-4ee4-b302-bf928ec432b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.006285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6ac9a-4ccd-4ee4-b302-bf928ec432b5 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.019072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 939/1879] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:09.023717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42227b83-d81d-4d44-a17d-6aa926a43eff admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.035916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42227b83-d81d-4d44-a17d-6aa926a43eff admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.040971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc65887-1c21-4a53-bc44-b194e1f085eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.041668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc65887-1c21-4a53-bc44-b194e1f085eb admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.041950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc65887-1c21-4a53-bc44-b194e1f085eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.042243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc65887-1c21-4a53-bc44-b194e1f085eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.043036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc65887-1c21-4a53-bc44-b194e1f085eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.044620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc65887-1c21-4a53-bc44-b194e1f085eb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.058156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 941/1880] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:09.064053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6ac9a-4ccd-4ee4-b302-bf928ec432b5 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.074335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6ac9a-4ccd-4ee4-b302-bf928ec432b5 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.079855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de644a-9c97-4cb4-a3cc-66b88765878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.080757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de644a-9c97-4cb4-a3cc-66b88765878e admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.081049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de644a-9c97-4cb4-a3cc-66b88765878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.081329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de644a-9c97-4cb4-a3cc-66b88765878e admin admin] PATH_INFO: `/v3/projects/cd97136d4f444dbf95591675579193ff/users/edf4c63a3ed944a7985fe57a88bdd526/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.111963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de644a-9c97-4cb4-a3cc-66b88765878e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd97136d4f444dbf95591675579193ff, user_id=edf4c63a3ed944a7985fe57a88bdd526, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.113524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de644a-9c97-4cb4-a3cc-66b88765878e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.127792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 940/1881] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:09 2022] PUT /identity/v3/projects/cd97136d4f444dbf95591675579193ff/users/edf4c63a3ed944a7985fe57a88bdd526/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:09.138145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5708-5e5d-4606-bdc9-dffa34b74dbf None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.138444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5708-5e5d-4606-bdc9-dffa34b74dbf None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.138731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5708-5e5d-4606-bdc9-dffa34b74dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.158684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:09.167027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-051f5708-5e5d-4606-bdc9-dffa34b74dbf None None] MFA Rules not processed for user `edf4c63a3ed944a7985fe57a88bdd526`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:09.169025 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-051f5708-5e5d-4606-bdc9-dffa34b74dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:09.238408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 942/1882] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:09.242675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de644a-9c97-4cb4-a3cc-66b88765878e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.269209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:09.307077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de644a-9c97-4cb4-a3cc-66b88765878e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.312523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5ff56-522d-4dc3-8e8a-0228f35ecb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.313185 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5ff56-522d-4dc3-8e8a-0228f35ecb17 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.313474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5ff56-522d-4dc3-8e8a-0228f35ecb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.313757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5ff56-522d-4dc3-8e8a-0228f35ecb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.314456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5ff56-522d-4dc3-8e8a-0228f35ecb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.316406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5ff56-522d-4dc3-8e8a-0228f35ecb17 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.345262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 941/1883] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:09 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:09.349772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5708-5e5d-4606-bdc9-dffa34b74dbf None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.363775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5708-5e5d-4606-bdc9-dffa34b74dbf None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.454598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89479-11c2-46be-8321-0b08727cd1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.455439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89479-11c2-46be-8321-0b08727cd1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.455896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89479-11c2-46be-8321-0b08727cd1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.456184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89479-11c2-46be-8321-0b08727cd1ec admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.456898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89479-11c2-46be-8321-0b08727cd1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.458848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89479-11c2-46be-8321-0b08727cd1ec admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.483564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 943/1884] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:09 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:09.485686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5ff56-522d-4dc3-8e8a-0228f35ecb17 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.496350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5ff56-522d-4dc3-8e8a-0228f35ecb17 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.502467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e829eb7-4a61-4b69-913f-4632945a6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.503196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e829eb7-4a61-4b69-913f-4632945a6b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.503571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e829eb7-4a61-4b69-913f-4632945a6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.504156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e829eb7-4a61-4b69-913f-4632945a6b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.504898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e829eb7-4a61-4b69-913f-4632945a6b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.506519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e829eb7-4a61-4b69-913f-4632945a6b84 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.517979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 942/1885] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:09.522193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89479-11c2-46be-8321-0b08727cd1ec admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.533085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89479-11c2-46be-8321-0b08727cd1ec admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.547640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273f414-19bd-4986-913b-39a66f3f201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.548762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f414-19bd-4986-913b-39a66f3f201f admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.549344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f414-19bd-4986-913b-39a66f3f201f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.550997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273f414-19bd-4986-913b-39a66f3f201f admin admin] PATH_INFO: `/v3/projects/9ca50129302748c9a16af9354f9a021f/users/ab7125caf220417a8386fe7cc5a165aa/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.572068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273f414-19bd-4986-913b-39a66f3f201f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca50129302748c9a16af9354f9a021f, user_id=ab7125caf220417a8386fe7cc5a165aa, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.575590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273f414-19bd-4986-913b-39a66f3f201f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.593820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 944/1886] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:09 2022] PUT /identity/v3/projects/9ca50129302748c9a16af9354f9a021f/users/ab7125caf220417a8386fe7cc5a165aa/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:09.597786 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e829eb7-4a61-4b69-913f-4632945a6b84 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.621890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e829eb7-4a61-4b69-913f-4632945a6b84 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.706507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23fa41-59e4-431f-a5d9-04dd81330713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.707380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fa41-59e4-431f-a5d9-04dd81330713 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.707669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fa41-59e4-431f-a5d9-04dd81330713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.707951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fa41-59e4-431f-a5d9-04dd81330713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.708715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23fa41-59e4-431f-a5d9-04dd81330713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.710865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23fa41-59e4-431f-a5d9-04dd81330713 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.721281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 943/1887] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:09.725373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273f414-19bd-4986-913b-39a66f3f201f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.736676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273f414-19bd-4986-913b-39a66f3f201f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:09.741560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:09.742466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.742855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.743202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] PATH_INFO: `/v3/projects/9ca50129302748c9a16af9354f9a021f/users/ab7125caf220417a8386fe7cc5a165aa/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.745250 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca50129302748c9a16af9354f9a021f, user_id=ab7125caf220417a8386fe7cc5a165aa, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:09.748071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:09.771702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 945/1888] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:09 2022] PUT /identity/v3/projects/9ca50129302748c9a16af9354f9a021f/users/ab7125caf220417a8386fe7cc5a165aa/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:09.775614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b670fc7-eb4f-41f5-891d-a89953cf1fd2 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:09.775935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b670fc7-eb4f-41f5-891d-a89953cf1fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:09.776316 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b670fc7-eb4f-41f5-891d-a89953cf1fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:09.808459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-8b670fc7-eb4f-41f5-891d-a89953cf1fd2 None None] MFA Rules not processed for user `ab7125caf220417a8386fe7cc5a165aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:09.809621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8b670fc7-eb4f-41f5-891d-a89953cf1fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:09.927434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 944/1889] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:09.972644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:09.974376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:10.020543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b670fc7-eb4f-41f5-891d-a89953cf1fd2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:10.022160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8b670fc7-eb4f-41f5-891d-a89953cf1fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:10.051227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ef565-0619-4ceb-b3a3-7bf3d7dd7d26 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:10.055051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3adc-d5fb-42d8-9e68-53a97489d0ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:10.055722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3adc-d5fb-42d8-9e68-53a97489d0ae service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:10.056007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3adc-d5fb-42d8-9e68-53a97489d0ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:10.056292 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3adc-d5fb-42d8-9e68-53a97489d0ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:10.061253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:10.065172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:10.068168 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c3adc-d5fb-42d8-9e68-53a97489d0ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:10.069820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c3adc-d5fb-42d8-9e68-53a97489d0ae service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:10.082529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 946/1890] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:10.164397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b670fc7-eb4f-41f5-891d-a89953cf1fd2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:10.171295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:10.178335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:10.178802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:10.179192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:10.183974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:10.326839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:10.329184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:10.342104 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 945/1891] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:10.520882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3adc-d5fb-42d8-9e68-53a97489d0ae service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:10.531933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3adc-d5fb-42d8-9e68-53a97489d0ae service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:10.538225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7125caf220417a8386fe7cc5a165aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ca50129302748c9a16af9354f9a021f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:10.539025 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:10.539312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:10.539618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:10.540383 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:10.540887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:10.542665 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:10.575418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:10.582515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 947/1892] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:10.587658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7fdc8-5fd6-40de-b873-8c09383d7637 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:10.592916 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5bed-8d97-486e-b930-340a55c7c8ea tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7125caf220417a8386fe7cc5a165aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ca50129302748c9a16af9354f9a021f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:10.594138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5bed-8d97-486e-b930-340a55c7c8ea tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:10.594430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5bed-8d97-486e-b930-340a55c7c8ea tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:10.594710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b5bed-8d97-486e-b930-340a55c7c8ea tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:10.595481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b5bed-8d97-486e-b930-340a55c7c8ea tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:10.598208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b5bed-8d97-486e-b930-340a55c7c8ea tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:10.639013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 946/1893] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:10 2022] POST /identity/v3/projects => generated 354 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:10.639313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:10.649851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14f8ba-7036-48a2-932e-d05f3c87b61b tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:10.731200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7125caf220417a8386fe7cc5a165aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ca50129302748c9a16af9354f9a021f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:10.731896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:10.732191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:10.732477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:10.733210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:10.733522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:10.735851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:10.750956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 948/1894] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:10.817533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5bed-8d97-486e-b930-340a55c7c8ea tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:10.829247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b5bed-8d97-486e-b930-340a55c7c8ea tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:10.834173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7125caf220417a8386fe7cc5a165aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ca50129302748c9a16af9354f9a021f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:10.835160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:10.835526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:10.835881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] PATH_INFO: `/v3/projects/9b2b8343ace242ffb9304c2f4a4784b7` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:10.837368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b2b8343ace242ffb9304c2f4a4784b7)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:10.839656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:10.891611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2b8343ace242ffb9304c2f4a4784b7', 'request_id': 'req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:10.897975 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2b8343ace242ffb9304c2f4a4784b7', 'request_id': 'req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:10.905070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2b8343ace242ffb9304c2f4a4784b7', 'request_id': 'req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:10.920183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] The token cache is being invalidate because project 9b2b8343ace242ffb9304c2f4a4784b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:10.920501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:10.921188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8fe2c6c9-beb6-4f21-9484-64656a7d04d8 tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:10.923482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 947/1895] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:10 2022] DELETE /identity/v3/projects/9b2b8343ace242ffb9304c2f4a4784b7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:11.204184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:11.205968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:11.278011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d74ed0-1905-4766-8729-49fcf19f0eec tempest-VolumeQuotaClassesTest-1804691713 tempest-VolumeQuotaClassesTest-1804691713-project-admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:11.344934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:11.347700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:11.347700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:11.347700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] PATH_INFO: `/v3/users/edf4c63a3ed944a7985fe57a88bdd526` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:11.348487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf4c63a3ed944a7985fe57a88bdd526)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:11.351271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:11.386332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:11.418423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf4c63a3ed944a7985fe57a88bdd526'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:11.419334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf4c63a3ed944a7985fe57a88bdd526'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:11.429866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf4c63a3ed944a7985fe57a88bdd526'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:11.439723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf4c63a3ed944a7985fe57a88bdd526'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:11.468150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf4c63a3ed944a7985fe57a88bdd526'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:11.477903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 949/1896] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:11 2022] DELETE /identity/v3/users/edf4c63a3ed944a7985fe57a88bdd526 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:11.482221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf8de-ef2d-4e4b-ac61-5a17b4f8e2b5 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:11.482516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf8de-ef2d-4e4b-ac61-5a17b4f8e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:11.482819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf8de-ef2d-4e4b-ac61-5a17b4f8e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:11.521925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-abbaf8de-ef2d-4e4b-ac61-5a17b4f8e2b5 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:11.523225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-abbaf8de-ef2d-4e4b-ac61-5a17b4f8e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:11.549826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:11.597247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 948/1897] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:11.630692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:11.632256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:11.738810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80ad82-514e-42c5-8a0b-11426931e2a5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:11.743114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e895e8-95ff-45da-b4ab-54c91586a1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:11.743553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e895e8-95ff-45da-b4ab-54c91586a1cb service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:11.743841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e895e8-95ff-45da-b4ab-54c91586a1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:11.744122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e895e8-95ff-45da-b4ab-54c91586a1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:11.779953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e895e8-95ff-45da-b4ab-54c91586a1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:11.781660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e895e8-95ff-45da-b4ab-54c91586a1cb service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:11.800361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 950/1898] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:12.789741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaf8de-ef2d-4e4b-ac61-5a17b4f8e2b5 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:12.792281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-abbaf8de-ef2d-4e4b-ac61-5a17b4f8e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:12.804858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaf8de-ef2d-4e4b-ac61-5a17b4f8e2b5 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:12.811079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:12.812800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:12.813304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:12.813796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] PATH_INFO: `/v3/projects/cd97136d4f444dbf95591675579193ff` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:12.815294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd97136d4f444dbf95591675579193ff)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:12.817494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:12.917999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd97136d4f444dbf95591675579193ff', 'request_id': 'req-d8797395-4cc7-40ab-be4f-03f911e8acb5'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:12.925606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd97136d4f444dbf95591675579193ff', 'request_id': 'req-d8797395-4cc7-40ab-be4f-03f911e8acb5'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:12.933198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd97136d4f444dbf95591675579193ff', 'request_id': 'req-d8797395-4cc7-40ab-be4f-03f911e8acb5'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:12.949223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] The token cache is being invalidate because project cd97136d4f444dbf95591675579193ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:12.949537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:12.950841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:12.953793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 949/1899] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:12 2022] DELETE /identity/v3/projects/cd97136d4f444dbf95591675579193ff => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:12.957290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e895e8-95ff-45da-b4ab-54c91586a1cb service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:12.968230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e895e8-95ff-45da-b4ab-54c91586a1cb service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:13.049158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:13.049158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:13.049158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:13.049158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] PATH_INFO: `/v3/users/ab7125caf220417a8386fe7cc5a165aa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:13.049600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7125caf220417a8386fe7cc5a165aa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:13.049863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:13.123410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7125caf220417a8386fe7cc5a165aa'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:13.125512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7125caf220417a8386fe7cc5a165aa'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:13.135108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:13.145015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7125caf220417a8386fe7cc5a165aa'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:13.155355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7125caf220417a8386fe7cc5a165aa'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:13.177314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3e30873a-78f8-4c22-94c9-53293f5e9e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7125caf220417a8386fe7cc5a165aa'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:13.187336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 951/1900] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:12 2022] DELETE /identity/v3/users/ab7125caf220417a8386fe7cc5a165aa => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:13.995459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:13.999357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:14.016084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8797395-4cc7-40ab-be4f-03f911e8acb5 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:14.128374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:14.129734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.130183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.130628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] PATH_INFO: `/v3/projects/9ca50129302748c9a16af9354f9a021f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.133134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca50129302748c9a16af9354f9a021f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:14.137457 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:14.207683 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca50129302748c9a16af9354f9a021f', 'request_id': 'req-f94f7da9-a2bf-41d8-962e-f85b721dce17'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:14.212994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:14.226107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca50129302748c9a16af9354f9a021f', 'request_id': 'req-f94f7da9-a2bf-41d8-962e-f85b721dce17'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:14.233351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca50129302748c9a16af9354f9a021f', 'request_id': 'req-f94f7da9-a2bf-41d8-962e-f85b721dce17'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:14.260293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] The token cache is being invalidate because project 9ca50129302748c9a16af9354f9a021f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:14.260592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:14.261494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f94f7da9-a2bf-41d8-962e-f85b721dce17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:14.264048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 950/1901] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:13 2022] DELETE /identity/v3/projects/9ca50129302748c9a16af9354f9a021f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:14.270335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143f75-23bc-490b-be28-e167263eb9e8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.271260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143f75-23bc-490b-be28-e167263eb9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.271917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143f75-23bc-490b-be28-e167263eb9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.306637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a0143f75-23bc-490b-be28-e167263eb9e8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:14.308809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a0143f75-23bc-490b-be28-e167263eb9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:14.391822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 952/1902] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:14.400100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82282f8-1a87-4f83-aae6-39bc79fd4b16 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.400323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82282f8-1a87-4f83-aae6-39bc79fd4b16 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.400770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82282f8-1a87-4f83-aae6-39bc79fd4b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.422261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f82282f8-1a87-4f83-aae6-39bc79fd4b16 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:14.423563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f82282f8-1a87-4f83-aae6-39bc79fd4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:14.439066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 951/1903] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:14.444797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143f75-23bc-490b-be28-e167263eb9e8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:14.456258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143f75-23bc-490b-be28-e167263eb9e8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:14.461116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:14.461828 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.462123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.462408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.463182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:14.463744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:14.465562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:14.497097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 953/1904] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:14.502061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82282f8-1a87-4f83-aae6-39bc79fd4b16 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:14.520594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82282f8-1a87-4f83-aae6-39bc79fd4b16 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:14.526623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33ffed-6465-4e62-8a36-e1f7688697bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:14.527674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ffed-6465-4e62-8a36-e1f7688697bf admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.528238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ffed-6465-4e62-8a36-e1f7688697bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.528596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ffed-6465-4e62-8a36-e1f7688697bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.529434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33ffed-6465-4e62-8a36-e1f7688697bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:14.532238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33ffed-6465-4e62-8a36-e1f7688697bf admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:14.584190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 952/1905] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:14 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:14.589037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:14.601647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72ec6e-efc3-4b4d-ba7e-14e3c149cd38 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:14.671344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008192b8-f63f-4dd1-8b35-3cc2fd3a88cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:14.672125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008192b8-f63f-4dd1-8b35-3cc2fd3a88cc admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.672490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008192b8-f63f-4dd1-8b35-3cc2fd3a88cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.672844 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008192b8-f63f-4dd1-8b35-3cc2fd3a88cc admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.673685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008192b8-f63f-4dd1-8b35-3cc2fd3a88cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:14.675959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008192b8-f63f-4dd1-8b35-3cc2fd3a88cc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:14.698308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 954/1906] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:14 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:14.702948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33ffed-6465-4e62-8a36-e1f7688697bf admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:14.713271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33ffed-6465-4e62-8a36-e1f7688697bf admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:14.718351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab03f3a-30f2-416e-bb3d-f9c946c8eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:14.719137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03f3a-30f2-416e-bb3d-f9c946c8eed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.719432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03f3a-30f2-416e-bb3d-f9c946c8eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.719758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03f3a-30f2-416e-bb3d-f9c946c8eed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.721038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab03f3a-30f2-416e-bb3d-f9c946c8eed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:14.723315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab03f3a-30f2-416e-bb3d-f9c946c8eed7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:14.735503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 953/1907] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:14.739912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008192b8-f63f-4dd1-8b35-3cc2fd3a88cc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:14.750974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008192b8-f63f-4dd1-8b35-3cc2fd3a88cc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:14.755846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d798f13-a074-4dd6-bd22-a54fc877cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:14.756890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d798f13-a074-4dd6-bd22-a54fc877cb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.757252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d798f13-a074-4dd6-bd22-a54fc877cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.757600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d798f13-a074-4dd6-bd22-a54fc877cb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.758482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d798f13-a074-4dd6-bd22-a54fc877cb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:14.760197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d798f13-a074-4dd6-bd22-a54fc877cb6e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:14.771408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 955/1908] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:14.775506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab03f3a-30f2-416e-bb3d-f9c946c8eed7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:14.788193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab03f3a-30f2-416e-bb3d-f9c946c8eed7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:14.793473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d04b7-6106-43d0-81f4-7b72547cc64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:14.794462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d04b7-6106-43d0-81f4-7b72547cc64b admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.794853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d04b7-6106-43d0-81f4-7b72547cc64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.795231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d04b7-6106-43d0-81f4-7b72547cc64b admin admin] PATH_INFO: `/v3/projects/99b4bbebab5340f5a5d882fca4285e6c/users/ca31a198c54a447f993f9f04e371e9c4/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.815771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d04b7-6106-43d0-81f4-7b72547cc64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b4bbebab5340f5a5d882fca4285e6c, user_id=ca31a198c54a447f993f9f04e371e9c4, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:14.818820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d04b7-6106-43d0-81f4-7b72547cc64b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:14.836620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 954/1909] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:14 2022] PUT /identity/v3/projects/99b4bbebab5340f5a5d882fca4285e6c/users/ca31a198c54a447f993f9f04e371e9c4/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:14.846358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5452-b755-4781-97c3-def47e5ec93e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.850271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5452-b755-4781-97c3-def47e5ec93e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.850560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5452-b755-4781-97c3-def47e5ec93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.880361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ccff5452-b755-4781-97c3-def47e5ec93e None None] MFA Rules not processed for user `ca31a198c54a447f993f9f04e371e9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:14.881600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ccff5452-b755-4781-97c3-def47e5ec93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:14.902172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:14.965319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 956/1910] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:14.970367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d04b7-6106-43d0-81f4-7b72547cc64b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.041743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d04b7-6106-43d0-81f4-7b72547cc64b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:15.053841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc96ee7-ddae-4e7f-a3ac-7758e862060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:15.054561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96ee7-ddae-4e7f-a3ac-7758e862060a admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.054870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96ee7-ddae-4e7f-a3ac-7758e862060a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.055156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96ee7-ddae-4e7f-a3ac-7758e862060a admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.056383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc96ee7-ddae-4e7f-a3ac-7758e862060a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:15.059723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc96ee7-ddae-4e7f-a3ac-7758e862060a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:15.098525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 955/1911] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:14 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:15.100017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5452-b755-4781-97c3-def47e5ec93e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.122393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5452-b755-4781-97c3-def47e5ec93e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:15.263996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c4034-8008-40a0-8340-ac3b4b80a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:15.273110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c4034-8008-40a0-8340-ac3b4b80a1be admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.273770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c4034-8008-40a0-8340-ac3b4b80a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.273770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c4034-8008-40a0-8340-ac3b4b80a1be admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.274402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c4034-8008-40a0-8340-ac3b4b80a1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:15.276508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c4034-8008-40a0-8340-ac3b4b80a1be admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:15.326796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 957/1912] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:15 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:15.331108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc96ee7-ddae-4e7f-a3ac-7758e862060a admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.349387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc96ee7-ddae-4e7f-a3ac-7758e862060a admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:15.365682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b49bf-4489-42cb-899d-2a572d5b7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:15.368321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b49bf-4489-42cb-899d-2a572d5b7b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.368628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b49bf-4489-42cb-899d-2a572d5b7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.368921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b49bf-4489-42cb-899d-2a572d5b7b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.369685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b49bf-4489-42cb-899d-2a572d5b7b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:15.375910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b49bf-4489-42cb-899d-2a572d5b7b2f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:15.393668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 956/1913] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:15.397972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c4034-8008-40a0-8340-ac3b4b80a1be admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.418032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c4034-8008-40a0-8340-ac3b4b80a1be admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:15.426418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:15.427928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.428484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.428969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] PATH_INFO: `/v3/projects/f33172b2e82f40ec91758da0ba0052bc/users/12ca6503e5c94cc6b707f903e2c09e2e/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.463546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33172b2e82f40ec91758da0ba0052bc, user_id=12ca6503e5c94cc6b707f903e2c09e2e, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:15.466544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:15.488855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 958/1914] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:15 2022] PUT /identity/v3/projects/f33172b2e82f40ec91758da0ba0052bc/users/12ca6503e5c94cc6b707f903e2c09e2e/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:15.493079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b49bf-4489-42cb-899d-2a572d5b7b2f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.506947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b49bf-4489-42cb-899d-2a572d5b7b2f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:15.616390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:15.638741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdbbda-0d97-4bba-b888-8adf2a1a4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:15.639560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdbbda-0d97-4bba-b888-8adf2a1a4efd admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.639948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdbbda-0d97-4bba-b888-8adf2a1a4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.640332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdbbda-0d97-4bba-b888-8adf2a1a4efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.641134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdbbda-0d97-4bba-b888-8adf2a1a4efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:15.642850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdbbda-0d97-4bba-b888-8adf2a1a4efd admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:15.650807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.652535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:15.658803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 957/1915] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:15.660017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdbbda-0d97-4bba-b888-8adf2a1a4efd admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.666193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589ed4a-64d0-4c01-9853-28c36a4a917e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:15.671509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:15.671668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdbbda-0d97-4bba-b888-8adf2a1a4efd admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:15.672405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.672696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.672978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] PATH_INFO: `/v3/users/fddc22c9952645dd8b272175d85a96b8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.674335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddc22c9952645dd8b272175d85a96b8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:15.676538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:15.676657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a29bfb-15fe-4e13-9d7b-eb23675409c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:15.677906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29bfb-15fe-4e13-9d7b-eb23675409c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.678265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29bfb-15fe-4e13-9d7b-eb23675409c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.678666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29bfb-15fe-4e13-9d7b-eb23675409c8 admin admin] PATH_INFO: `/v3/projects/f33172b2e82f40ec91758da0ba0052bc/users/12ca6503e5c94cc6b707f903e2c09e2e/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.680897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a29bfb-15fe-4e13-9d7b-eb23675409c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33172b2e82f40ec91758da0ba0052bc, user_id=12ca6503e5c94cc6b707f903e2c09e2e, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:15.683794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a29bfb-15fe-4e13-9d7b-eb23675409c8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:15.722661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 958/1916] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:15 2022] PUT /identity/v3/projects/f33172b2e82f40ec91758da0ba0052bc/users/12ca6503e5c94cc6b707f903e2c09e2e/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:15.735400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8a095-002f-448f-a75f-28a4e7d21cde None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.735706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8a095-002f-448f-a75f-28a4e7d21cde None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.735995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8a095-002f-448f-a75f-28a4e7d21cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.770163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddc22c9952645dd8b272175d85a96b8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:15.770940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddc22c9952645dd8b272175d85a96b8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:15.772277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-21a8a095-002f-448f-a75f-28a4e7d21cde None None] MFA Rules not processed for user `12ca6503e5c94cc6b707f903e2c09e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:15.773634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-21a8a095-002f-448f-a75f-28a4e7d21cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:15.781305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddc22c9952645dd8b272175d85a96b8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:15.790191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddc22c9952645dd8b272175d85a96b8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:15.809023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d501a8fc-f04a-43f2-9bb0-0aada72dd545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddc22c9952645dd8b272175d85a96b8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:15.810947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:15.823611 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 959/1917] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:15 2022] DELETE /identity/v3/users/fddc22c9952645dd8b272175d85a96b8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:15.828278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507268b-a003-48ba-8a7a-6650b084f557 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:15.828572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507268b-a003-48ba-8a7a-6650b084f557 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:15.829105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507268b-a003-48ba-8a7a-6650b084f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:15.852760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9507268b-a003-48ba-8a7a-6650b084f557 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:15.853978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9507268b-a003-48ba-8a7a-6650b084f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:15.856154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 959/1918] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:15.868159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8a095-002f-448f-a75f-28a4e7d21cde None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.869558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-21a8a095-002f-448f-a75f-28a4e7d21cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:15.928061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 960/1919] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:15.940243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507268b-a003-48ba-8a7a-6650b084f557 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:15.941782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9507268b-a003-48ba-8a7a-6650b084f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:15.951478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8a095-002f-448f-a75f-28a4e7d21cde None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:16.056412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507268b-a003-48ba-8a7a-6650b084f557 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:16.064497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:16.065085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:16.065342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:16.065620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:16.068700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f84be-a019-43dc-a7b1-9c7076cf78b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:16.069384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f84be-a019-43dc-a7b1-9c7076cf78b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:16.069671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f84be-a019-43dc-a7b1-9c7076cf78b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:16.069949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f84be-a019-43dc-a7b1-9c7076cf78b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:16.082195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f84be-a019-43dc-a7b1-9c7076cf78b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:16.085618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f84be-a019-43dc-a7b1-9c7076cf78b2 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:16.115428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 961/1920] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:16.119354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:16.224458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:16.227736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:16.242397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 960/1921] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:16.300483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f84be-a019-43dc-a7b1-9c7076cf78b2 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:16.325306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f84be-a019-43dc-a7b1-9c7076cf78b2 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:16.329911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:16.330724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:16.331136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:16.331516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:16.333653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:16.424390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:16.425907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:16.436783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 962/1922] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:16.753176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:16.757644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:16.797078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a717f9-dae4-4b7a-b583-0dfcf8bbee20 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:16.807547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:16.808451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:16.808744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:16.809045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] PATH_INFO: `/v3/projects/b35930abd60a4b828a38df347ac2bc9e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:16.814449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35930abd60a4b828a38df347ac2bc9e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:16.825214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:16.903846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35930abd60a4b828a38df347ac2bc9e', 'request_id': 'req-346da97f-4b5c-4264-a2ec-b054ae504ea8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:16.911722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35930abd60a4b828a38df347ac2bc9e', 'request_id': 'req-346da97f-4b5c-4264-a2ec-b054ae504ea8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:16.921968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35930abd60a4b828a38df347ac2bc9e', 'request_id': 'req-346da97f-4b5c-4264-a2ec-b054ae504ea8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:16.938663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] The token cache is being invalidate because project b35930abd60a4b828a38df347ac2bc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:16.939053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:16.939717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:16.941276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 961/1923] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:16 2022] DELETE /identity/v3/projects/b35930abd60a4b828a38df347ac2bc9e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:16.945217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:16.956669 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741531-5d43-4633-9b86-99eae767974e service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:16.997898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:17.020192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:17.021143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:17.021461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:17.021704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] PATH_INFO: `/v3/users/42f438af5f704572afd1ee32df7f6aa6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:17.022955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f438af5f704572afd1ee32df7f6aa6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:17.025122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:17.088324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f438af5f704572afd1ee32df7f6aa6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.089632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f438af5f704572afd1ee32df7f6aa6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.100410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f438af5f704572afd1ee32df7f6aa6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.111205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f438af5f704572afd1ee32df7f6aa6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.125440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9985ff8e-8b18-4df9-9be2-8f456b59c270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f438af5f704572afd1ee32df7f6aa6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.135354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 963/1924] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:16 2022] DELETE /identity/v3/users/42f438af5f704572afd1ee32df7f6aa6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:17.431937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:17.434109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:17.450573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da97f-4b5c-4264-a2ec-b054ae504ea8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:17.534332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:17.535340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:17.535848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:17.536334 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] PATH_INFO: `/v3/projects/2c0876b978a04718a31484d6406e80f2` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:17.538031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0876b978a04718a31484d6406e80f2)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:17.540258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:17.633588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0876b978a04718a31484d6406e80f2', 'request_id': 'req-3ad1ba5d-93ba-49f8-aef0-1be78200199b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.636706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:17.644942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0876b978a04718a31484d6406e80f2', 'request_id': 'req-3ad1ba5d-93ba-49f8-aef0-1be78200199b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.658027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0876b978a04718a31484d6406e80f2', 'request_id': 'req-3ad1ba5d-93ba-49f8-aef0-1be78200199b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.673887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] The token cache is being invalidate because project 2c0876b978a04718a31484d6406e80f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:17.673887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.674628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3ad1ba5d-93ba-49f8-aef0-1be78200199b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:17.676646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 962/1925] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:17 2022] DELETE /identity/v3/projects/2c0876b978a04718a31484d6406e80f2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:17.682479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1036-a770-436c-90ab-adce5ba07bb4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:17.682976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1036-a770-436c-90ab-adce5ba07bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:17.683299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1036-a770-436c-90ab-adce5ba07bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:17.701866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2e2f1036-a770-436c-90ab-adce5ba07bb4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:17.704097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2e2f1036-a770-436c-90ab-adce5ba07bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:17.768141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 964/1926] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:17.776611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee018-ec23-42f0-9235-183419160b9b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:17.776611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee018-ec23-42f0-9235-183419160b9b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:17.776882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee018-ec23-42f0-9235-183419160b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:17.795663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-943ee018-ec23-42f0-9235-183419160b9b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:17.797533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-943ee018-ec23-42f0-9235-183419160b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:17.807083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 963/1927] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:17.811468 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f1036-a770-436c-90ab-adce5ba07bb4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:17.823398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f1036-a770-436c-90ab-adce5ba07bb4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:17.830467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:17.831379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:17.831845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:17.832320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:17.833245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:17.833627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:17.835459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:17.848221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 965/1928] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:17.852287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee018-ec23-42f0-9235-183419160b9b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:17.862180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee018-ec23-42f0-9235-183419160b9b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:17.867573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261eb04-9a27-43f4-b3e6-b312bb542d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:17.868236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261eb04-9a27-43f4-b3e6-b312bb542d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:17.868531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261eb04-9a27-43f4-b3e6-b312bb542d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:17.868859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261eb04-9a27-43f4-b3e6-b312bb542d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:17.869562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261eb04-9a27-43f4-b3e6-b312bb542d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:17.871504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261eb04-9a27-43f4-b3e6-b312bb542d39 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:17.910866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 964/1929] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:17 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:17.928176 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:17.941366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093e28b-0237-4e1c-acf5-9bfee1a99f51 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:18.003805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:18.022730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d8d3e-0cef-4308-a51a-93c86150ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:18.023779 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d8d3e-0cef-4308-a51a-93c86150ee77 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.024668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d8d3e-0cef-4308-a51a-93c86150ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.025222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d8d3e-0cef-4308-a51a-93c86150ee77 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.026174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d8d3e-0cef-4308-a51a-93c86150ee77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:18.028534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d8d3e-0cef-4308-a51a-93c86150ee77 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:18.053423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 966/1930] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:17 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:18.058723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261eb04-9a27-43f4-b3e6-b312bb542d39 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:18.070591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261eb04-9a27-43f4-b3e6-b312bb542d39 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:18.076612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e53c8-7902-483a-94c9-d6169b02390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:18.077299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e53c8-7902-483a-94c9-d6169b02390e admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.077593 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e53c8-7902-483a-94c9-d6169b02390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.078445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e53c8-7902-483a-94c9-d6169b02390e admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.078654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e53c8-7902-483a-94c9-d6169b02390e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:18.080286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e53c8-7902-483a-94c9-d6169b02390e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:18.091429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 965/1931] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:18.096102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d8d3e-0cef-4308-a51a-93c86150ee77 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:18.107005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d8d3e-0cef-4308-a51a-93c86150ee77 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:18.113047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780ba1-3570-4212-8067-a0ebb5e730cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:18.113947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780ba1-3570-4212-8067-a0ebb5e730cf admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.114242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780ba1-3570-4212-8067-a0ebb5e730cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.114528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780ba1-3570-4212-8067-a0ebb5e730cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.115304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780ba1-3570-4212-8067-a0ebb5e730cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:18.117051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780ba1-3570-4212-8067-a0ebb5e730cf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:18.132678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 967/1932] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:18.133764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e53c8-7902-483a-94c9-d6169b02390e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:18.146004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e53c8-7902-483a-94c9-d6169b02390e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:18.151053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:18.152160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.152664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.152935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] PATH_INFO: `/v3/projects/97ccc49808d8466994b080bd390e4650/users/f20a48aa2f3e49ce9becdcdc10bd14ab/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.169833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ccc49808d8466994b080bd390e4650, user_id=f20a48aa2f3e49ce9becdcdc10bd14ab, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:18.172941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:18.189147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 966/1933] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:18 2022] PUT /identity/v3/projects/97ccc49808d8466994b080bd390e4650/users/f20a48aa2f3e49ce9becdcdc10bd14ab/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:18.201746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baa25e-edcb-4306-b8ba-70bebbe0a66d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.202980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baa25e-edcb-4306-b8ba-70bebbe0a66d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.204486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baa25e-edcb-4306-b8ba-70bebbe0a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.242676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b3baa25e-edcb-4306-b8ba-70bebbe0a66d None None] MFA Rules not processed for user `f20a48aa2f3e49ce9becdcdc10bd14ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:18.245203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b3baa25e-edcb-4306-b8ba-70bebbe0a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:18.354857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 968/1934] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:18.366892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:18.369484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:18.447592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc537a3-d780-4b8a-9a30-fbc7d4ceff95 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:18.453532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd633b7-a5ca-4ae5-9ace-9a2b4e545a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:18.455401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd633b7-a5ca-4ae5-9ace-9a2b4e545a5a service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.455754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd633b7-a5ca-4ae5-9ace-9a2b4e545a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.456245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd633b7-a5ca-4ae5-9ace-9a2b4e545a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.466124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd633b7-a5ca-4ae5-9ace-9a2b4e545a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:18.468576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd633b7-a5ca-4ae5-9ace-9a2b4e545a5a service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:18.481102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 967/1935] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:18.506455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baa25e-edcb-4306-b8ba-70bebbe0a66d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:18.614534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baa25e-edcb-4306-b8ba-70bebbe0a66d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:18.621779 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:18.625035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.625548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.626019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] PATH_INFO: `/v3/users/f20a48aa2f3e49ce9becdcdc10bd14ab` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.627431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20a48aa2f3e49ce9becdcdc10bd14ab)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:18.641428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:18.715623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20a48aa2f3e49ce9becdcdc10bd14ab'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:18.716458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20a48aa2f3e49ce9becdcdc10bd14ab'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:18.734478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20a48aa2f3e49ce9becdcdc10bd14ab'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:18.746605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:18.775858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20a48aa2f3e49ce9becdcdc10bd14ab'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:18.800009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20a48aa2f3e49ce9becdcdc10bd14ab'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:18.807278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 969/1936] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:18 2022] DELETE /identity/v3/users/f20a48aa2f3e49ce9becdcdc10bd14ab => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:18.812788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9cf8b-7ef7-4440-a0aa-f79b683f83e9 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.813166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9cf8b-7ef7-4440-a0aa-f79b683f83e9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.813447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9cf8b-7ef7-4440-a0aa-f79b683f83e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.834122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-6af9cf8b-7ef7-4440-a0aa-f79b683f83e9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:18.835311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6af9cf8b-7ef7-4440-a0aa-f79b683f83e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:18.944285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 968/1937] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:18.953930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:18.955410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:19.016667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93f464-2f86-482a-8586-9257576e51b8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:19.020506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940faeec-3457-4114-a1fb-55ad7352affb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:19.021368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940faeec-3457-4114-a1fb-55ad7352affb service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:19.021727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940faeec-3457-4114-a1fb-55ad7352affb service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:19.022075 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940faeec-3457-4114-a1fb-55ad7352affb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:19.032192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940faeec-3457-4114-a1fb-55ad7352affb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:19.034102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940faeec-3457-4114-a1fb-55ad7352affb service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:19.044870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 970/1938] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:19.794753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9cf8b-7ef7-4440-a0aa-f79b683f83e9 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:19.797018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6af9cf8b-7ef7-4440-a0aa-f79b683f83e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:19.824176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9cf8b-7ef7-4440-a0aa-f79b683f83e9 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:19.832114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:19.833590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:19.833950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:19.834306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] PATH_INFO: `/v3/projects/97ccc49808d8466994b080bd390e4650` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:19.835681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ccc49808d8466994b080bd390e4650)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:19.837955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:19.856823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:19.890328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ccc49808d8466994b080bd390e4650', 'request_id': 'req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:19.895648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ccc49808d8466994b080bd390e4650', 'request_id': 'req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:19.901738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ccc49808d8466994b080bd390e4650', 'request_id': 'req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:19.934576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] The token cache is being invalidate because project 97ccc49808d8466994b080bd390e4650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:19.936815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:19.938694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dff14d28-b5d0-4e1d-8c1b-61fe016ce7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:19.958506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 969/1939] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:19 2022] DELETE /identity/v3/projects/97ccc49808d8466994b080bd390e4650 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:19.958605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82b1b-777f-4406-8fbd-070f11cc776f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:19.958605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82b1b-777f-4406-8fbd-070f11cc776f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:19.958605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82b1b-777f-4406-8fbd-070f11cc776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:19.982678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2ba82b1b-777f-4406-8fbd-070f11cc776f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:19.984419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2ba82b1b-777f-4406-8fbd-070f11cc776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.092017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 971/1940] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:20.100877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4340d-d903-4d9e-83c6-9518659f6bf1 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.101320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4340d-d903-4d9e-83c6-9518659f6bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.101450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4340d-d903-4d9e-83c6-9518659f6bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.126136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a1c4340d-d903-4d9e-83c6-9518659f6bf1 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:20.127766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a1c4340d-d903-4d9e-83c6-9518659f6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.137803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 970/1941] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:20.144629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba82b1b-777f-4406-8fbd-070f11cc776f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.156157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba82b1b-777f-4406-8fbd-070f11cc776f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.163699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.164319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.164605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.164888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.165622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:20.165934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.167755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.178116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4340d-d903-4d9e-83c6-9518659f6bf1 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.179795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a1c4340d-d903-4d9e-83c6-9518659f6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.193501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4340d-d903-4d9e-83c6-9518659f6bf1 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.196335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 972/1942] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:20.198325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.200179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.208837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.209856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.210146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.210430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] PATH_INFO: `/v3/users/ca31a198c54a447f993f9f04e371e9c4` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.211843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca31a198c54a447f993f9f04e371e9c4)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.213947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.216890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6b2b-fc97-46c9-8aac-707210ebc264 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.225435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.227281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.228921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.229272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] PATH_INFO: `/v3/users/6f53680f4e054bb3964a596ded8f05f3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.231766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f53680f4e054bb3964a596ded8f05f3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.235404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.296402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca31a198c54a447f993f9f04e371e9c4'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.318859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca31a198c54a447f993f9f04e371e9c4'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.319673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca31a198c54a447f993f9f04e371e9c4'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.325862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f53680f4e054bb3964a596ded8f05f3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.326763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f53680f4e054bb3964a596ded8f05f3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.328392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca31a198c54a447f993f9f04e371e9c4'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.336412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f53680f4e054bb3964a596ded8f05f3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.337469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca31a198c54a447f993f9f04e371e9c4'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.341721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:20.345113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f53680f4e054bb3964a596ded8f05f3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.348274 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 971/1943] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:20 2022] DELETE /identity/v3/users/ca31a198c54a447f993f9f04e371e9c4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:20.349717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.351418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.363403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-302ee916-1cff-4ec5-b942-05e7c913afa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f53680f4e054bb3964a596ded8f05f3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:20.371772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 973/1944] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:20 2022] DELETE /identity/v3/users/6f53680f4e054bb3964a596ded8f05f3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:20.373718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba8bd-9318-4934-92d8-73f20441725f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.374521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba8bd-9318-4934-92d8-73f20441725f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.374850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba8bd-9318-4934-92d8-73f20441725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.394930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2f5ba8bd-9318-4934-92d8-73f20441725f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:20.396155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2f5ba8bd-9318-4934-92d8-73f20441725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.442818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882386c4-aa23-4a45-a7af-cd177fa2c42a admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.455981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:20.464566 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 974/1945] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:20.466291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c343e5-8930-4019-bfbb-95dc6fcb0fa2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.466291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c343e5-8930-4019-bfbb-95dc6fcb0fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.466534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c343e5-8930-4019-bfbb-95dc6fcb0fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.491627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-57c343e5-8930-4019-bfbb-95dc6fcb0fa2 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:20.493299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-57c343e5-8930-4019-bfbb-95dc6fcb0fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.503034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 975/1946] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:20.503938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c343e5-8930-4019-bfbb-95dc6fcb0fa2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.505488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-57c343e5-8930-4019-bfbb-95dc6fcb0fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.511946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.512633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.512927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.513211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.513935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.516474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.544519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 972/1947] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:20 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:20.545562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.547352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.565517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c343e5-8930-4019-bfbb-95dc6fcb0fa2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.603212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720befad-3027-41e0-a71b-e220edb75697 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.606888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.607542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.607836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.608117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.615362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25290d-4cbc-4325-a467-6be727fe6c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.616036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25290d-4cbc-4325-a467-6be727fe6c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.616332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25290d-4cbc-4325-a467-6be727fe6c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.616650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25290d-4cbc-4325-a467-6be727fe6c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.658616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:20.669758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.671253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.679631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25290d-4cbc-4325-a467-6be727fe6c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.680837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 973/1948] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:20.681185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25290d-4cbc-4325-a467-6be727fe6c68 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.681600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.682952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.692066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 976/1949] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:20.695620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0ec09-26ce-4043-b3bc-bc747ce9ef0c service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.700244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd8dbc-8749-49cd-b17c-bba672dc371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.700913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd8dbc-8749-49cd-b17c-bba672dc371f admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.701199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd8dbc-8749-49cd-b17c-bba672dc371f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.701480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd8dbc-8749-49cd-b17c-bba672dc371f admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.703165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd8dbc-8749-49cd-b17c-bba672dc371f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.705277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd8dbc-8749-49cd-b17c-bba672dc371f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.725747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 974/1950] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:20 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:20.729772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25290d-4cbc-4325-a467-6be727fe6c68 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.740625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25290d-4cbc-4325-a467-6be727fe6c68 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.745961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52491a-b821-491b-8154-cb4cfe263cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.746657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52491a-b821-491b-8154-cb4cfe263cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.747347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52491a-b821-491b-8154-cb4cfe263cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.747347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52491a-b821-491b-8154-cb4cfe263cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.748059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52491a-b821-491b-8154-cb4cfe263cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.750354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52491a-b821-491b-8154-cb4cfe263cf4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.762218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 977/1951] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:20.766376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd8dbc-8749-49cd-b17c-bba672dc371f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.776851 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd8dbc-8749-49cd-b17c-bba672dc371f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.782491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a1ff-9aaa-46e2-ad6e-94c4e0c2ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.783481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a1ff-9aaa-46e2-ad6e-94c4e0c2ff0a admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.783803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a1ff-9aaa-46e2-ad6e-94c4e0c2ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.784205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a1ff-9aaa-46e2-ad6e-94c4e0c2ff0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.784998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a1ff-9aaa-46e2-ad6e-94c4e0c2ff0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.786615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a1ff-9aaa-46e2-ad6e-94c4e0c2ff0a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.798145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 975/1952] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:20.802384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52491a-b821-491b-8154-cb4cfe263cf4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.814022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52491a-b821-491b-8154-cb4cfe263cf4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.819536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.820703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.821033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.821324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] PATH_INFO: `/v3/projects/0144b5a8cbda488f8b31433e0f8edac7/users/5d98c639517c435e841cc0c762971c8d/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.837194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0144b5a8cbda488f8b31433e0f8edac7, user_id=5d98c639517c435e841cc0c762971c8d, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.839916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.854919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 978/1953] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:20 2022] PUT /identity/v3/projects/0144b5a8cbda488f8b31433e0f8edac7/users/5d98c639517c435e841cc0c762971c8d/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:20.866319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aff427-24f6-4069-a239-236866aad51e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.866615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aff427-24f6-4069-a239-236866aad51e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.866955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aff427-24f6-4069-a239-236866aad51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.894914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-c9aff427-24f6-4069-a239-236866aad51e None None] MFA Rules not processed for user `5d98c639517c435e841cc0c762971c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:20.896131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c9aff427-24f6-4069-a239-236866aad51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.905132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:20.973342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 976/1954] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:20.985975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.988002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.077005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7b275-70c6-447d-bc4c-a7adaaee1184 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.080960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57c6ab-2546-498c-bd44-fe20f877c92d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.081759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c6ab-2546-498c-bd44-fe20f877c92d service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.082114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c6ab-2546-498c-bd44-fe20f877c92d service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.082407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c6ab-2546-498c-bd44-fe20f877c92d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.093869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57c6ab-2546-498c-bd44-fe20f877c92d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.095827 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57c6ab-2546-498c-bd44-fe20f877c92d service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.105732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 979/1955] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:21.110183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aff427-24f6-4069-a239-236866aad51e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.112336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c9aff427-24f6-4069-a239-236866aad51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.130701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57c6ab-2546-498c-bd44-fe20f877c92d service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.224625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57c6ab-2546-498c-bd44-fe20f877c92d service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.232879 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.234474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.235051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.235799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] PATH_INFO: `/v3/users/5d98c639517c435e841cc0c762971c8d` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.237581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d98c639517c435e841cc0c762971c8d)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.239929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.242254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aff427-24f6-4069-a239-236866aad51e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.246891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.247887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.248171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.248451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] PATH_INFO: `/v3/projects/99b4bbebab5340f5a5d882fca4285e6c` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.250151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b4bbebab5340f5a5d882fca4285e6c)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.252108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.287381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:21.289251 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d98c639517c435e841cc0c762971c8d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.289957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d98c639517c435e841cc0c762971c8d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.299771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d98c639517c435e841cc0c762971c8d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.308673 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d98c639517c435e841cc0c762971c8d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.316162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b4bbebab5340f5a5d882fca4285e6c', 'request_id': 'req-7abe5fab-1059-4a82-893a-caf4847c4223'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.321896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d98c639517c435e841cc0c762971c8d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.322042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b4bbebab5340f5a5d882fca4285e6c', 'request_id': 'req-7abe5fab-1059-4a82-893a-caf4847c4223'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.329530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 980/1956] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:21 2022] DELETE /identity/v3/users/5d98c639517c435e841cc0c762971c8d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:21.332416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b4bbebab5340f5a5d882fca4285e6c', 'request_id': 'req-7abe5fab-1059-4a82-893a-caf4847c4223'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.332541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.332541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.343255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] The token cache is being invalidate because project 99b4bbebab5340f5a5d882fca4285e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:21.343633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.344261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7abe5fab-1059-4a82-893a-caf4847c4223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.345879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 977/1957] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:21 2022] DELETE /identity/v3/projects/99b4bbebab5340f5a5d882fca4285e6c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:21.348133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564381-115b-4489-81c5-ac63cc9086fe None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.348721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564381-115b-4489-81c5-ac63cc9086fe None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.349012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564381-115b-4489-81c5-ac63cc9086fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.367544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ba564381-115b-4489-81c5-ac63cc9086fe None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:21.368915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ba564381-115b-4489-81c5-ac63cc9086fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.405823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15e3e-4856-4e68-9140-4e7fa3182fd3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.410631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:21.410922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.412175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.412487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.412780 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] PATH_INFO: `/v3/projects/49886d1bdc3f4027af7d16784d037097` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.414495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=49886d1bdc3f4027af7d16784d037097)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.416079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.435573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 978/1958] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:21.439713 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba564381-115b-4489-81c5-ac63cc9086fe None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.441078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ba564381-115b-4489-81c5-ac63cc9086fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.456515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba564381-115b-4489-81c5-ac63cc9086fe None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.461260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.462149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.462444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.462803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] PATH_INFO: `/v3/users/12ca6503e5c94cc6b707f903e2c09e2e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.463981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ca6503e5c94cc6b707f903e2c09e2e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.465926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.480462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49886d1bdc3f4027af7d16784d037097', 'request_id': 'req-7395bf46-0559-48ec-a2f7-863761aa34bf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.486971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49886d1bdc3f4027af7d16784d037097', 'request_id': 'req-7395bf46-0559-48ec-a2f7-863761aa34bf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.493590 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49886d1bdc3f4027af7d16784d037097', 'request_id': 'req-7395bf46-0559-48ec-a2f7-863761aa34bf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.509466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] The token cache is being invalidate because project 49886d1bdc3f4027af7d16784d037097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:21.509772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.510727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.513231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 981/1959] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:21 2022] DELETE /identity/v3/projects/49886d1bdc3f4027af7d16784d037097 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:21.514131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.518983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.538706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ca6503e5c94cc6b707f903e2c09e2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.553393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ca6503e5c94cc6b707f903e2c09e2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.554163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ca6503e5c94cc6b707f903e2c09e2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.563237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ca6503e5c94cc6b707f903e2c09e2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.574634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-48fa81d7-6544-403d-8ecd-c4325e3b1909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ca6503e5c94cc6b707f903e2c09e2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:21.583694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 979/1960] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:21 2022] DELETE /identity/v3/users/12ca6503e5c94cc6b707f903e2c09e2e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:21.584926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9022-ad94-4bab-9bf4-83406a85d5fe None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.585294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9022-ad94-4bab-9bf4-83406a85d5fe None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.585651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9022-ad94-4bab-9bf4-83406a85d5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.608233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-593b9022-ad94-4bab-9bf4-83406a85d5fe None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:21.609523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-593b9022-ad94-4bab-9bf4-83406a85d5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.610598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395bf46-0559-48ec-a2f7-863761aa34bf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.619177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:21.694113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.694900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.695222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.695753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.697712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.706723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 980/1961] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:21.708580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943925-7b69-4544-b3e9-ef972f0b9f7c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.709067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943925-7b69-4544-b3e9-ef972f0b9f7c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.709390 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943925-7b69-4544-b3e9-ef972f0b9f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.718134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.719792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.732353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 982/1962] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:21.736343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-24943925-7b69-4544-b3e9-ef972f0b9f7c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:21.737647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-24943925-7b69-4544-b3e9-ef972f0b9f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.745908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 981/1963] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:21.750896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.760537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a82b5-b9bf-4f95-94bc-259506fee765 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.765345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.766031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.766327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.766822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.767574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:21.767892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.769525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.782092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 983/1964] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:21.787425 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24943925-7b69-4544-b3e9-ef972f0b9f7c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.797950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24943925-7b69-4544-b3e9-ef972f0b9f7c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.807398 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d55ad-7ae4-43d5-87e3-8ca3a45d1c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.820256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d55ad-7ae4-43d5-87e3-8ca3a45d1c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.821909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d55ad-7ae4-43d5-87e3-8ca3a45d1c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.823218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d55ad-7ae4-43d5-87e3-8ca3a45d1c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.824193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d55ad-7ae4-43d5-87e3-8ca3a45d1c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.827372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d55ad-7ae4-43d5-87e3-8ca3a45d1c34 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.862825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 982/1965] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:21 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:21.864309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.875155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb19d6-e49a-43bd-9678-4e22f1c2e900 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:21.947081 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175773c-8919-43d3-98b3-4df10f6565b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:21.947890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175773c-8919-43d3-98b3-4df10f6565b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.948185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175773c-8919-43d3-98b3-4df10f6565b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.948475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175773c-8919-43d3-98b3-4df10f6565b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.949282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175773c-8919-43d3-98b3-4df10f6565b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:21.951884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175773c-8919-43d3-98b3-4df10f6565b5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:21.988286 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 984/1966] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:21 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:21.989222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d55ad-7ae4-43d5-87e3-8ca3a45d1c34 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.003324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d55ad-7ae4-43d5-87e3-8ca3a45d1c34 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.009842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.011181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.011809 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.012243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.013289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.015365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.035958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 983/1967] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:22.036612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175773c-8919-43d3-98b3-4df10f6565b5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.048509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.050499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.057636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175773c-8919-43d3-98b3-4df10f6565b5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.064206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00cef7-827f-47b2-a242-3ef5d66d576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.067406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00cef7-827f-47b2-a242-3ef5d66d576d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.067497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00cef7-827f-47b2-a242-3ef5d66d576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.067771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00cef7-827f-47b2-a242-3ef5d66d576d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.068562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00cef7-827f-47b2-a242-3ef5d66d576d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.070356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00cef7-827f-47b2-a242-3ef5d66d576d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.071991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d241-c45d-43d2-ba68-f22c4a1825f9 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.080360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.081554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.081925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 985/1968] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:22.082308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.082840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] PATH_INFO: `/v3/projects/f33172b2e82f40ec91758da0ba0052bc` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.084570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33172b2e82f40ec91758da0ba0052bc)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.087368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.088153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00cef7-827f-47b2-a242-3ef5d66d576d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.099553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00cef7-827f-47b2-a242-3ef5d66d576d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.104005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:22.104522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.106467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.106788 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.107376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] PATH_INFO: `/v3/projects/a6769dcf93a14a338b8e90ef2ee4f6f5/users/4b9dd3284c3c4868bda7151e608a02f2/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.129592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6769dcf93a14a338b8e90ef2ee4f6f5, user_id=4b9dd3284c3c4868bda7151e608a02f2, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.132877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.161571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 986/1969] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:22 2022] PUT /identity/v3/projects/a6769dcf93a14a338b8e90ef2ee4f6f5/users/4b9dd3284c3c4868bda7151e608a02f2/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:22.175271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.177876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.182084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33172b2e82f40ec91758da0ba0052bc', 'request_id': 'req-1c92ac63-652c-40f4-a602-21ae7bc534fa'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.188918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33172b2e82f40ec91758da0ba0052bc', 'request_id': 'req-1c92ac63-652c-40f4-a602-21ae7bc534fa'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.221596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33172b2e82f40ec91758da0ba0052bc', 'request_id': 'req-1c92ac63-652c-40f4-a602-21ae7bc534fa'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.240365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] The token cache is being invalidate because project f33172b2e82f40ec91758da0ba0052bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:22.240711 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.241416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1c92ac63-652c-40f4-a602-21ae7bc534fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.243932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 984/1970] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:22 2022] DELETE /identity/v3/projects/f33172b2e82f40ec91758da0ba0052bc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:22.245587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f89d-e336-41dd-b401-ef2872bb5c71 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.245895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f89d-e336-41dd-b401-ef2872bb5c71 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.246179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f89d-e336-41dd-b401-ef2872bb5c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.250329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:22.268022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270cecb-1496-40bd-9aac-3760cd0aea57 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.281699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e602f89d-e336-41dd-b401-ef2872bb5c71 None None] MFA Rules not processed for user `4b9dd3284c3c4868bda7151e608a02f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:22.282986 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e602f89d-e336-41dd-b401-ef2872bb5c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.336180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.337829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.337829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.338029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] PATH_INFO: `/v3/projects/0144b5a8cbda488f8b31433e0f8edac7` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.339386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0144b5a8cbda488f8b31433e0f8edac7)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.341689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.361522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 985/1971] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:22.362913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc9d6-add3-4300-9405-7ee8047d9e60 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.363217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc9d6-add3-4300-9405-7ee8047d9e60 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.363745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc9d6-add3-4300-9405-7ee8047d9e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.384727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ec3bc9d6-add3-4300-9405-7ee8047d9e60 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:22.386086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ec3bc9d6-add3-4300-9405-7ee8047d9e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.402899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0144b5a8cbda488f8b31433e0f8edac7', 'request_id': 'req-b3337bf6-04ac-45b8-abf6-06aa1ed71207'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.413643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0144b5a8cbda488f8b31433e0f8edac7', 'request_id': 'req-b3337bf6-04ac-45b8-abf6-06aa1ed71207'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.422814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0144b5a8cbda488f8b31433e0f8edac7', 'request_id': 'req-b3337bf6-04ac-45b8-abf6-06aa1ed71207'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.437729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] The token cache is being invalidate because project 0144b5a8cbda488f8b31433e0f8edac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:22.438034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.438931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:22.442832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 987/1972] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:22 2022] DELETE /identity/v3/projects/0144b5a8cbda488f8b31433e0f8edac7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:22.442832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.443158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.454946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 986/1973] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:22.462473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579403-69dc-43cf-9aa3-26458a39bc25 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.463234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579403-69dc-43cf-9aa3-26458a39bc25 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.463234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579403-69dc-43cf-9aa3-26458a39bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.486405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-97579403-69dc-43cf-9aa3-26458a39bc25 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:22.487740 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-97579403-69dc-43cf-9aa3-26458a39bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.496278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 987/1974] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:22.497490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed24b74-ae2b-48e0-81a9-6713f46e82e9 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.497883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed24b74-ae2b-48e0-81a9-6713f46e82e9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.498261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed24b74-ae2b-48e0-81a9-6713f46e82e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.517536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-bed24b74-ae2b-48e0-81a9-6713f46e82e9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:22.518562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337bf6-04ac-45b8-abf6-06aa1ed71207 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.519293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-bed24b74-ae2b-48e0-81a9-6713f46e82e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.522918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.523618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.523873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.524214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.526036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.528737 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 988/1975] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:22.534200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a6c3-dc20-4693-bec6-fea0b1339247 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.534200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a6c3-dc20-4693-bec6-fea0b1339247 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.534613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a6c3-dc20-4693-bec6-fea0b1339247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.553897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-bfe8a6c3-dc20-4693-bec6-fea0b1339247 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:22.555153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-bfe8a6c3-dc20-4693-bec6-fea0b1339247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.564120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 989/1976] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:22.565640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a6c3-dc20-4693-bec6-fea0b1339247 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.575557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a6c3-dc20-4693-bec6-fea0b1339247 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.580915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:22.582622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.583306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.583769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.584037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.584770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:22.585195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.587040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.590930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:22.601921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 990/1977] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:22.602942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.606910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.609951 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.616008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1b3d5-9a27-407f-bf5b-9911557643e0 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.622622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 988/1978] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:22.623132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.623721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.624545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.624902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.625317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.626044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:22.626322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.628795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.638982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a4a0-b4b9-40ba-8f52-74c7d1b08fd7 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.645485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 991/1979] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:22.646941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e912ea-362c-49e7-ad36-3aff7f78aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.647718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e912ea-362c-49e7-ad36-3aff7f78aa87 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.648084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e912ea-362c-49e7-ad36-3aff7f78aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.648433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e912ea-362c-49e7-ad36-3aff7f78aa87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.649319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e912ea-362c-49e7-ad36-3aff7f78aa87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.649799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.651420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e912ea-362c-49e7-ad36-3aff7f78aa87 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.662443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f614c-1760-49b5-b3ee-2a65b3bb1de8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.668286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f0e29-8c9c-476c-be15-b1b4c7b47b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.668954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0e29-8c9c-476c-be15-b1b4c7b47b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.669296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0e29-8c9c-476c-be15-b1b4c7b47b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.669628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f0e29-8c9c-476c-be15-b1b4c7b47b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.670333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f0e29-8c9c-476c-be15-b1b4c7b47b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.672399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f0e29-8c9c-476c-be15-b1b4c7b47b14 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.691458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 989/1980] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/projects => generated 401 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:22.696885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e912ea-362c-49e7-ad36-3aff7f78aa87 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.711744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 992/1981] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:22.722335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f0e29-8c9c-476c-be15-b1b4c7b47b14 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.785886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e912ea-362c-49e7-ad36-3aff7f78aa87 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.829932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f0e29-8c9c-476c-be15-b1b4c7b47b14 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.836377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d9a4-134c-46ad-8fc0-36f1b81c58b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.837081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d9a4-134c-46ad-8fc0-36f1b81c58b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.837388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d9a4-134c-46ad-8fc0-36f1b81c58b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.837651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d9a4-134c-46ad-8fc0-36f1b81c58b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.838432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72d9a4-134c-46ad-8fc0-36f1b81c58b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.840473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72d9a4-134c-46ad-8fc0-36f1b81c58b6 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.890907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 993/1982] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:22.894621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d9a4-134c-46ad-8fc0-36f1b81c58b6 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.904861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d9a4-134c-46ad-8fc0-36f1b81c58b6 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.908145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649600f-62ab-4a45-b72c-19d1088d362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.909116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649600f-62ab-4a45-b72c-19d1088d362c admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.909539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649600f-62ab-4a45-b72c-19d1088d362c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.910012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649600f-62ab-4a45-b72c-19d1088d362c admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.910546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649600f-62ab-4a45-b72c-19d1088d362c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.911480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f414473-873c-4e4b-bb3f-9a7dd78e0c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.912296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f414473-873c-4e4b-bb3f-9a7dd78e0c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.912698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f414473-873c-4e4b-bb3f-9a7dd78e0c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.913056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f414473-873c-4e4b-bb3f-9a7dd78e0c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.913171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649600f-62ab-4a45-b72c-19d1088d362c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.913980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f414473-873c-4e4b-bb3f-9a7dd78e0c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.916383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f414473-873c-4e4b-bb3f-9a7dd78e0c32 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.942017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 994/1983] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:22.946753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f414473-873c-4e4b-bb3f-9a7dd78e0c32 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.948367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 990/1984] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:22 2022] POST /identity/v3/users => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:22.953911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649600f-62ab-4a45-b72c-19d1088d362c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.961535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f414473-873c-4e4b-bb3f-9a7dd78e0c32 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.967022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670891-2830-453c-9131-f253b892187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.967917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670891-2830-453c-9131-f253b892187c admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.968311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670891-2830-453c-9131-f253b892187c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.968701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670891-2830-453c-9131-f253b892187c admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.969454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649600f-62ab-4a45-b72c-19d1088d362c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.969695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66670891-2830-453c-9131-f253b892187c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.971493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66670891-2830-453c-9131-f253b892187c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.976034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a4e48-c2fa-47e1-a0f9-1c350f482be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.977080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a4e48-c2fa-47e1-a0f9-1c350f482be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.977534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a4e48-c2fa-47e1-a0f9-1c350f482be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.978617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a4e48-c2fa-47e1-a0f9-1c350f482be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.979639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a4e48-c2fa-47e1-a0f9-1c350f482be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.981911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a4e48-c2fa-47e1-a0f9-1c350f482be2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.990250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 995/1985] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:22.992257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670891-2830-453c-9131-f253b892187c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:22.996273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 991/1986] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:23.000451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a4e48-c2fa-47e1-a0f9-1c350f482be2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.011742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670891-2830-453c-9131-f253b892187c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.014627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a4e48-c2fa-47e1-a0f9-1c350f482be2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.019388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bde85d-5afe-4d12-824c-3d3046c19193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.021702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde85d-5afe-4d12-824c-3d3046c19193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.022165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde85d-5afe-4d12-824c-3d3046c19193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.023027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3fc37-6467-4614-9ae8-0bc7c9a9dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.023455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde85d-5afe-4d12-824c-3d3046c19193 admin admin] PATH_INFO: `/v3/projects/87cfc720cba445c5973859341b4c390d/users/0080fc96d28c481d96b90554adc8684a/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.027295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fc37-6467-4614-9ae8-0bc7c9a9dd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.027807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fc37-6467-4614-9ae8-0bc7c9a9dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.028231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3fc37-6467-4614-9ae8-0bc7c9a9dd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.029121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3fc37-6467-4614-9ae8-0bc7c9a9dd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.031010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3fc37-6467-4614-9ae8-0bc7c9a9dd45 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.055208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 992/1987] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:23.056143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde85d-5afe-4d12-824c-3d3046c19193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cfc720cba445c5973859341b4c390d, user_id=0080fc96d28c481d96b90554adc8684a, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.057021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3fc37-6467-4614-9ae8-0bc7c9a9dd45 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.060186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde85d-5afe-4d12-824c-3d3046c19193 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.073110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3fc37-6467-4614-9ae8-0bc7c9a9dd45 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.087911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 996/1988] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:22 2022] PUT /identity/v3/projects/87cfc720cba445c5973859341b4c390d/users/0080fc96d28c481d96b90554adc8684a/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:23.099527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7865-7f05-4d8e-8d37-bcbbc3c8a856 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.100267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7865-7f05-4d8e-8d37-bcbbc3c8a856 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.100791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7865-7f05-4d8e-8d37-bcbbc3c8a856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.143023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ba4e7865-7f05-4d8e-8d37-bcbbc3c8a856 None None] MFA Rules not processed for user `0080fc96d28c481d96b90554adc8684a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:23.145975 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ba4e7865-7f05-4d8e-8d37-bcbbc3c8a856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:23.164304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:23.198269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879f4a0-1dfb-48d9-980e-6ceed7686619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.200078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f4a0-1dfb-48d9-980e-6ceed7686619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.200078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f4a0-1dfb-48d9-980e-6ceed7686619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.200078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f4a0-1dfb-48d9-980e-6ceed7686619 admin admin] PATH_INFO: `/v3/projects/bab908e9d99343bbb1e3d51f9a5f54d7/users/f51691af6c494fba895236c979bdfc85/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.221447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879f4a0-1dfb-48d9-980e-6ceed7686619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab908e9d99343bbb1e3d51f9a5f54d7, user_id=f51691af6c494fba895236c979bdfc85, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.224468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:23.226592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879f4a0-1dfb-48d9-980e-6ceed7686619 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.239849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 997/1989] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:23.242436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 993/1990] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:23 2022] PUT /identity/v3/projects/bab908e9d99343bbb1e3d51f9a5f54d7/users/f51691af6c494fba895236c979bdfc85/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:23.245808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e7865-7f05-4d8e-8d37-bcbbc3c8a856 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.254053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee69b76-030c-4a19-9485-3f645beb40be None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.254474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee69b76-030c-4a19-9485-3f645beb40be None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.254932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee69b76-030c-4a19-9485-3f645beb40be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.257378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e7865-7f05-4d8e-8d37-bcbbc3c8a856 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.281256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cee69b76-030c-4a19-9485-3f645beb40be None None] MFA Rules not processed for user `f51691af6c494fba895236c979bdfc85`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:23.282486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cee69b76-030c-4a19-9485-3f645beb40be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:23.343848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973cb97-1654-4d89-b2e1-324488030775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.344638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cb97-1654-4d89-b2e1-324488030775 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.344999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cb97-1654-4d89-b2e1-324488030775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.345349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cb97-1654-4d89-b2e1-324488030775 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.346123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973cb97-1654-4d89-b2e1-324488030775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.348177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973cb97-1654-4d89-b2e1-324488030775 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.362676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 994/1991] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:23.371817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee69b76-030c-4a19-9485-3f645beb40be None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.387251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 998/1992] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:23.388292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973cb97-1654-4d89-b2e1-324488030775 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.388847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee69b76-030c-4a19-9485-3f645beb40be None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.463110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973cb97-1654-4d89-b2e1-324488030775 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.470443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c68a-724b-4bc9-bb64-18501898f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.471606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c68a-724b-4bc9-bb64-18501898f716 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.471998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c68a-724b-4bc9-bb64-18501898f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.472352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c68a-724b-4bc9-bb64-18501898f716 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.473168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355c68a-724b-4bc9-bb64-18501898f716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.475396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355c68a-724b-4bc9-bb64-18501898f716 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.477610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf69d6-44b5-4623-93eb-6c556a3c4ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.478447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf69d6-44b5-4623-93eb-6c556a3c4ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.478894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf69d6-44b5-4623-93eb-6c556a3c4ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.479251 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf69d6-44b5-4623-93eb-6c556a3c4ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.480027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf69d6-44b5-4623-93eb-6c556a3c4ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.482384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf69d6-44b5-4623-93eb-6c556a3c4ae7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.503915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 999/1993] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:23.508114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c68a-724b-4bc9-bb64-18501898f716 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.519522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c68a-724b-4bc9-bb64-18501898f716 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.523458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 995/1994] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/projects => generated 401 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:23.524621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad730da9-64a8-4733-9db0-3736cafda801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.525299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730da9-64a8-4733-9db0-3736cafda801 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.525610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730da9-64a8-4733-9db0-3736cafda801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.525896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730da9-64a8-4733-9db0-3736cafda801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.526623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad730da9-64a8-4733-9db0-3736cafda801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.527434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf69d6-44b5-4623-93eb-6c556a3c4ae7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.528294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad730da9-64a8-4733-9db0-3736cafda801 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.539927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1000/1995] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:23.543751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad730da9-64a8-4733-9db0-3736cafda801 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.555372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad730da9-64a8-4733-9db0-3736cafda801 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.580687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:23.609983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf69d6-44b5-4623-93eb-6c556a3c4ae7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.616378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c38c6-2101-463d-8e4d-ea4b8fa6179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.617077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c38c6-2101-463d-8e4d-ea4b8fa6179d admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.617368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c38c6-2101-463d-8e4d-ea4b8fa6179d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.617683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c38c6-2101-463d-8e4d-ea4b8fa6179d admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.619068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c38c6-2101-463d-8e4d-ea4b8fa6179d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.619459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:23.621857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c38c6-2101-463d-8e4d-ea4b8fa6179d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.629776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849093a5-7e66-4a11-9e8c-53e7e2af433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.630920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849093a5-7e66-4a11-9e8c-53e7e2af433d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.631347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849093a5-7e66-4a11-9e8c-53e7e2af433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.631636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849093a5-7e66-4a11-9e8c-53e7e2af433d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.632437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849093a5-7e66-4a11-9e8c-53e7e2af433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.634276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849093a5-7e66-4a11-9e8c-53e7e2af433d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.645117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 996/1996] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/users => generated 307 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:23.648634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1001/1997] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:23.648825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c38c6-2101-463d-8e4d-ea4b8fa6179d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.652471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849093a5-7e66-4a11-9e8c-53e7e2af433d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.660583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c38c6-2101-463d-8e4d-ea4b8fa6179d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.662474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849093a5-7e66-4a11-9e8c-53e7e2af433d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.667001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533ad9-1ad4-4646-8af7-dccf4b225c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.667663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0d58c-8158-4054-ae80-275a626603ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.667809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533ad9-1ad4-4646-8af7-dccf4b225c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.668130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533ad9-1ad4-4646-8af7-dccf4b225c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.668234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d58c-8158-4054-ae80-275a626603ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.668501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d58c-8158-4054-ae80-275a626603ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.668616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a533ad9-1ad4-4646-8af7-dccf4b225c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.668780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d58c-8158-4054-ae80-275a626603ef admin admin] PATH_INFO: `/v3/projects/cbed3257deda4d3d9ab2154b795450c0/users/6116b18d4c8e41289b1d92bbcaaa2cd2/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.669484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533ad9-1ad4-4646-8af7-dccf4b225c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.671374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a533ad9-1ad4-4646-8af7-dccf4b225c17 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.688080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 997/1998] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:23.689084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0d58c-8158-4054-ae80-275a626603ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbed3257deda4d3d9ab2154b795450c0, user_id=6116b18d4c8e41289b1d92bbcaaa2cd2, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.689202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533ad9-1ad4-4646-8af7-dccf4b225c17 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.692059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0d58c-8158-4054-ae80-275a626603ef admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.699913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a533ad9-1ad4-4646-8af7-dccf4b225c17 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.709900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1002/1999] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:23 2022] PUT /identity/v3/projects/cbed3257deda4d3d9ab2154b795450c0/users/6116b18d4c8e41289b1d92bbcaaa2cd2/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:23.711937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cafe09-ecfb-4aed-89fd-6c95192cfba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.712894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafe09-ecfb-4aed-89fd-6c95192cfba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.713145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafe09-ecfb-4aed-89fd-6c95192cfba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.713432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafe09-ecfb-4aed-89fd-6c95192cfba7 admin admin] PATH_INFO: `/v3/projects/c0fa1e262fb248529b50938fdafe9932/users/09af20925d9c48f8bd4147c136003a74/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.728023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40944351-e514-49df-8c1d-6e43c84f339d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.728635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40944351-e514-49df-8c1d-6e43c84f339d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.729144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40944351-e514-49df-8c1d-6e43c84f339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.734939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cafe09-ecfb-4aed-89fd-6c95192cfba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fa1e262fb248529b50938fdafe9932, user_id=09af20925d9c48f8bd4147c136003a74, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.739540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cafe09-ecfb-4aed-89fd-6c95192cfba7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.766285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 998/2000] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:23 2022] PUT /identity/v3/projects/c0fa1e262fb248529b50938fdafe9932/users/09af20925d9c48f8bd4147c136003a74/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:23.767160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-40944351-e514-49df-8c1d-6e43c84f339d None None] MFA Rules not processed for user `6116b18d4c8e41289b1d92bbcaaa2cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:23.768259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cafe09-ecfb-4aed-89fd-6c95192cfba7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.768860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-40944351-e514-49df-8c1d-6e43c84f339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:23.882394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1003/2001] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:23.883339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40944351-e514-49df-8c1d-6e43c84f339d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.894504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cafe09-ecfb-4aed-89fd-6c95192cfba7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.894744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40944351-e514-49df-8c1d-6e43c84f339d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.900015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9403a-8569-4f7c-bdd4-36b16251559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.900453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732eb6c7-12c6-44e6-bc3d-566e18a9f3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.900688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9403a-8569-4f7c-bdd4-36b16251559a admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.900978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9403a-8569-4f7c-bdd4-36b16251559a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.901259 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9403a-8569-4f7c-bdd4-36b16251559a admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.901367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732eb6c7-12c6-44e6-bc3d-566e18a9f3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.901616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732eb6c7-12c6-44e6-bc3d-566e18a9f3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.901909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732eb6c7-12c6-44e6-bc3d-566e18a9f3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.902015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9403a-8569-4f7c-bdd4-36b16251559a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.902977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732eb6c7-12c6-44e6-bc3d-566e18a9f3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.903953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9403a-8569-4f7c-bdd4-36b16251559a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.905371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732eb6c7-12c6-44e6-bc3d-566e18a9f3a4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.922553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 999/2002] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:23.926560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732eb6c7-12c6-44e6-bc3d-566e18a9f3a4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.946297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732eb6c7-12c6-44e6-bc3d-566e18a9f3a4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.947428 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1004/2003] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:23.948481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9403a-8569-4f7c-bdd4-36b16251559a admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:24.027888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e304e7-2872-42cd-b2dc-a1e182ce6fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.028896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e304e7-2872-42cd-b2dc-a1e182ce6fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.029312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e304e7-2872-42cd-b2dc-a1e182ce6fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.029668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e304e7-2872-42cd-b2dc-a1e182ce6fb6 admin admin] PATH_INFO: `/v3/projects/c0fa1e262fb248529b50938fdafe9932/users/09af20925d9c48f8bd4147c136003a74/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.032297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e304e7-2872-42cd-b2dc-a1e182ce6fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fa1e262fb248529b50938fdafe9932, user_id=09af20925d9c48f8bd4147c136003a74, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.035980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e304e7-2872-42cd-b2dc-a1e182ce6fb6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.059686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1000/2004] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:23 2022] PUT /identity/v3/projects/c0fa1e262fb248529b50938fdafe9932/users/09af20925d9c48f8bd4147c136003a74/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:24.069165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9403a-8569-4f7c-bdd4-36b16251559a admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:24.075576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f1d0-2c78-4d92-b899-098e29bbbed7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.076002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f1d0-2c78-4d92-b899-098e29bbbed7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.076584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f1d0-2c78-4d92-b899-098e29bbbed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.114799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-eef2f1d0-2c78-4d92-b899-098e29bbbed7 None None] MFA Rules not processed for user `09af20925d9c48f8bd4147c136003a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:24.117569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-eef2f1d0-2c78-4d92-b899-098e29bbbed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:24.132541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:24.174205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:24.208075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40279853-20dd-4f12-899c-a8f5b2976892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.209107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40279853-20dd-4f12-899c-a8f5b2976892 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.209396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40279853-20dd-4f12-899c-a8f5b2976892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.209874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40279853-20dd-4f12-899c-a8f5b2976892 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.210679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40279853-20dd-4f12-899c-a8f5b2976892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.213689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40279853-20dd-4f12-899c-a8f5b2976892 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.265674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1005/2005] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:24.272065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce21c-375e-4d86-adc8-12fdd154f08b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.272613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce21c-375e-4d86-adc8-12fdd154f08b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.273309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce21c-375e-4d86-adc8-12fdd154f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.302708 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1001/2006] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:24.303824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2f1d0-2c78-4d92-b899-098e29bbbed7 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:24.328268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2f1d0-2c78-4d92-b899-098e29bbbed7 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:24.332153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-633ce21c-375e-4d86-adc8-12fdd154f08b None None] MFA Rules not processed for user `4b9dd3284c3c4868bda7151e608a02f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:24.334294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-633ce21c-375e-4d86-adc8-12fdd154f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:24.336610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d9f6-10b0-438b-b3f4-0810a4b70cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.337471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d9f6-10b0-438b-b3f4-0810a4b70cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.337810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d9f6-10b0-438b-b3f4-0810a4b70cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.338147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d9f6-10b0-438b-b3f4-0810a4b70cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.339232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d9f6-10b0-438b-b3f4-0810a4b70cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.341576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d9f6-10b0-438b-b3f4-0810a4b70cdb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.359059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1002/2007] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:24.359059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d9f6-10b0-438b-b3f4-0810a4b70cdb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:24.415651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1006/2008] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:24.415651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce21c-375e-4d86-adc8-12fdd154f08b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:24.425948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d9f6-10b0-438b-b3f4-0810a4b70cdb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:24.427119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce21c-375e-4d86-adc8-12fdd154f08b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:24.431327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc542f-853f-4246-8cca-702cf748160f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.432480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc542f-853f-4246-8cca-702cf748160f service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.433035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.433215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc542f-853f-4246-8cca-702cf748160f service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.433658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc542f-853f-4246-8cca-702cf748160f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.433946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.434236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.434516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] PATH_INFO: `/v3/projects/3321254bbf07486184bc3c42df50730e/users/14426ef5fd2c4bc39b6909ad2f8df161/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.445078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc542f-853f-4246-8cca-702cf748160f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.446554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc542f-853f-4246-8cca-702cf748160f service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.458447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3321254bbf07486184bc3c42df50730e, user_id=14426ef5fd2c4bc39b6909ad2f8df161, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.460823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1003/2009] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:24.461883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.484245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1007/2010] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:24 2022] PUT /identity/v3/projects/3321254bbf07486184bc3c42df50730e/users/14426ef5fd2c4bc39b6909ad2f8df161/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:24.488548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc542f-853f-4246-8cca-702cf748160f service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:24.500167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc542f-853f-4246-8cca-702cf748160f service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:24.541057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:24.542908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:24.569424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5955c0-dea1-4aea-9d2f-f1c131427937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.570026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5955c0-dea1-4aea-9d2f-f1c131427937 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.570318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5955c0-dea1-4aea-9d2f-f1c131427937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.570604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5955c0-dea1-4aea-9d2f-f1c131427937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.571750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5955c0-dea1-4aea-9d2f-f1c131427937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.573413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5955c0-dea1-4aea-9d2f-f1c131427937 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.588165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1004/2011] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:24.591758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5955c0-dea1-4aea-9d2f-f1c131427937 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:24.603496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5955c0-dea1-4aea-9d2f-f1c131427937 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:24.608270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b3364-0b00-484a-9098-5e81968950e4 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:24.608938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6e19-9612-4727-8c04-3b4eb605a16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.609846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6e19-9612-4727-8c04-3b4eb605a16c admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.610209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6e19-9612-4727-8c04-3b4eb605a16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.610584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6e19-9612-4727-8c04-3b4eb605a16c admin admin] PATH_INFO: `/v3/projects/3321254bbf07486184bc3c42df50730e/users/14426ef5fd2c4bc39b6909ad2f8df161/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.612502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4229b6-33df-4049-80aa-43839a14c71a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.613160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4229b6-33df-4049-80aa-43839a14c71a service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.613447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4229b6-33df-4049-80aa-43839a14c71a service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.613587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc6e19-9612-4727-8c04-3b4eb605a16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3321254bbf07486184bc3c42df50730e, user_id=14426ef5fd2c4bc39b6909ad2f8df161, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.613722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4229b6-33df-4049-80aa-43839a14c71a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.616605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc6e19-9612-4727-8c04-3b4eb605a16c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.627922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1005/2012] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:24 2022] PUT /identity/v3/projects/3321254bbf07486184bc3c42df50730e/users/14426ef5fd2c4bc39b6909ad2f8df161/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:24.639615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f83db-4e9c-48cb-bca8-edd6f88d4a24 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.639919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f83db-4e9c-48cb-bca8-edd6f88d4a24 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.640200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f83db-4e9c-48cb-bca8-edd6f88d4a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.668118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a47f83db-4e9c-48cb-bca8-edd6f88d4a24 None None] MFA Rules not processed for user `14426ef5fd2c4bc39b6909ad2f8df161`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:24.669351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a47f83db-4e9c-48cb-bca8-edd6f88d4a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:24.678715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:24.683217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4229b6-33df-4049-80aa-43839a14c71a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.684680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4229b6-33df-4049-80aa-43839a14c71a service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.695189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1008/2013] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:24.754706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1006/2014] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:24.765805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4229b6-33df-4049-80aa-43839a14c71a service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:24.779210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4229b6-33df-4049-80aa-43839a14c71a service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:24.785919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:24.855493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923dfc-2df5-49a0-bd6c-c9f25bf06d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:24.856180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923dfc-2df5-49a0-bd6c-c9f25bf06d8e service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.856532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923dfc-2df5-49a0-bd6c-c9f25bf06d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.856822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923dfc-2df5-49a0-bd6c-c9f25bf06d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.942339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923dfc-2df5-49a0-bd6c-c9f25bf06d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:24.944840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923dfc-2df5-49a0-bd6c-c9f25bf06d8e service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:24.963113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1009/2015] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:26.543890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f83db-4e9c-48cb-bca8-edd6f88d4a24 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:26.555981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f83db-4e9c-48cb-bca8-edd6f88d4a24 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:26.559923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f8a18-191c-4bde-806f-3474d5631671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:26.560701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8a18-191c-4bde-806f-3474d5631671 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:26.561136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8a18-191c-4bde-806f-3474d5631671 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:26.561927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f8a18-191c-4bde-806f-3474d5631671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:26.621238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f8a18-191c-4bde-806f-3474d5631671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:26.622685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f8a18-191c-4bde-806f-3474d5631671 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:26.632399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1007/2016] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:27.179973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923dfc-2df5-49a0-bd6c-c9f25bf06d8e service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:27.189032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923dfc-2df5-49a0-bd6c-c9f25bf06d8e service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:27.192773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a446d-b246-420c-beee-e48058367522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:27.193456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a446d-b246-420c-beee-e48058367522 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:27.193768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a446d-b246-420c-beee-e48058367522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:27.194044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a446d-b246-420c-beee-e48058367522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:27.204170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a446d-b246-420c-beee-e48058367522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:27.205607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a446d-b246-420c-beee-e48058367522 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:27.218231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1010/2017] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:29.054338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f8a18-191c-4bde-806f-3474d5631671 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:29.163356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f8a18-191c-4bde-806f-3474d5631671 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:29.169675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:29.171995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:29.171995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:29.171995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] PATH_INFO: `/v3/users/f51691af6c494fba895236c979bdfc85` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:29.189694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51691af6c494fba895236c979bdfc85)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:29.192955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:29.273898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:29.276117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51691af6c494fba895236c979bdfc85'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:29.277063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51691af6c494fba895236c979bdfc85'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:29.287387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51691af6c494fba895236c979bdfc85'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:29.307418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51691af6c494fba895236c979bdfc85'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:29.318732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51691af6c494fba895236c979bdfc85'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:29.326604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1008/2018] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:29 2022] DELETE /identity/v3/users/f51691af6c494fba895236c979bdfc85 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:29.331374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09f240-6cef-49b4-b582-e72cea341de4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:29.332275 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09f240-6cef-49b4-b582-e72cea341de4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:29.332719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09f240-6cef-49b4-b582-e72cea341de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:29.369067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-8f09f240-6cef-49b4-b582-e72cea341de4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:29.371441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8f09f240-6cef-49b4-b582-e72cea341de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:29.502347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1011/2019] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:29.518085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:29.521032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:29.650043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663e9a-ad2c-4adc-a0b3-388b0568b49c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:29.653982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:29.654886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:29.655720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:29.656150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:29.675656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09f240-6cef-49b4-b582-e72cea341de4 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:29.677506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8f09f240-6cef-49b4-b582-e72cea341de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:29.682310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:29.683973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:29.699784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1009/2020] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:29.765904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09f240-6cef-49b4-b582-e72cea341de4 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:29.771003 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:29.771751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:29.772114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:29.772469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:29.781982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:29.788930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:29.882858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:29.884631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:29.896888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1012/2021] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:30.290377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:30.293127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:30.319247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26549b4-3fad-4ab7-91e6-304e800eac27 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:30.324946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:30.326033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:30.326454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:30.326896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] PATH_INFO: `/v3/projects/bab908e9d99343bbb1e3d51f9a5f54d7` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:30.328202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab908e9d99343bbb1e3d51f9a5f54d7)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:30.330179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:30.385293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab908e9d99343bbb1e3d51f9a5f54d7', 'request_id': 'req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.393656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab908e9d99343bbb1e3d51f9a5f54d7', 'request_id': 'req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.401063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab908e9d99343bbb1e3d51f9a5f54d7', 'request_id': 'req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.416488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] The token cache is being invalidate because project bab908e9d99343bbb1e3d51f9a5f54d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:30.416843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.418623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.420380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1010/2022] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:30 2022] DELETE /identity/v3/projects/bab908e9d99343bbb1e3d51f9a5f54d7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:30.424943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:30.438936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15ecf5-fbd8-4cb1-8a4d-a689dc97ab1d service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:30.533640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:30.535313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:30.535609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:30.535927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] PATH_INFO: `/v3/users/09af20925d9c48f8bd4147c136003a74` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:30.547371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09af20925d9c48f8bd4147c136003a74)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:30.550503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:30.626756 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09af20925d9c48f8bd4147c136003a74'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.640967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09af20925d9c48f8bd4147c136003a74'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.641946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09af20925d9c48f8bd4147c136003a74'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.654246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09af20925d9c48f8bd4147c136003a74'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.663423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a109b209-03ed-4763-8d9b-ff357ec63db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09af20925d9c48f8bd4147c136003a74'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:30.671076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1013/2023] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:30 2022] DELETE /identity/v3/users/09af20925d9c48f8bd4147c136003a74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:31.082351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.084101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:31.117329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11f17-1198-48c8-9cf6-7c5a31fd0931 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.188199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:31.206491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.207592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.207985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.208487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] PATH_INFO: `/v3/projects/c0fa1e262fb248529b50938fdafe9932` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.210638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fa1e262fb248529b50938fdafe9932)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.212848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.272090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fa1e262fb248529b50938fdafe9932', 'request_id': 'req-5afeea17-ed31-49e5-8927-a0dd1b74275e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.281297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fa1e262fb248529b50938fdafe9932', 'request_id': 'req-5afeea17-ed31-49e5-8927-a0dd1b74275e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.287930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fa1e262fb248529b50938fdafe9932', 'request_id': 'req-5afeea17-ed31-49e5-8927-a0dd1b74275e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.317215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] The token cache is being invalidate because project c0fa1e262fb248529b50938fdafe9932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:31.317813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.318495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.323633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1011/2024] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:31 2022] DELETE /identity/v3/projects/c0fa1e262fb248529b50938fdafe9932 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:31.325942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d45e-6a3b-428c-ba14-078091335529 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.325942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d45e-6a3b-428c-ba14-078091335529 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.326233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47d45e-6a3b-428c-ba14-078091335529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.346956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ed47d45e-6a3b-428c-ba14-078091335529 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:31.348115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ed47d45e-6a3b-428c-ba14-078091335529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:31.348734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.350266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:31.363164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:31.433667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1014/2025] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:31.441980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b0eb-0406-44cc-b547-9dc7311c4edc None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.442486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b0eb-0406-44cc-b547-9dc7311c4edc None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.443084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b0eb-0406-44cc-b547-9dc7311c4edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.450346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeea17-ed31-49e5-8927-a0dd1b74275e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.456612 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.457519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.457812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.458094 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] PATH_INFO: `/v3/users/0080fc96d28c481d96b90554adc8684a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.459483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0080fc96d28c481d96b90554adc8684a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.461496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.465241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f4b4b0eb-0406-44cc-b547-9dc7311c4edc None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:31.466819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f4b4b0eb-0406-44cc-b547-9dc7311c4edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:31.475810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1015/2026] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:31.480022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4b0eb-0406-44cc-b547-9dc7311c4edc None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.491613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4b0eb-0406-44cc-b547-9dc7311c4edc None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.500123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.501046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.501803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.502324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.503296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:31.504311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.506341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.523568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1016/2027] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:31.530068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.530568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0080fc96d28c481d96b90554adc8684a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.531562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0080fc96d28c481d96b90554adc8684a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.541870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0080fc96d28c481d96b90554adc8684a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.545093 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3ed32-72a5-413b-a7e9-253f94b5db2e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.553812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0080fc96d28c481d96b90554adc8684a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.554571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.555552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.556319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.556755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.558154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.560690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.567742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-31fc29ee-5484-4466-a65c-435253281aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0080fc96d28c481d96b90554adc8684a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:31.569503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:31.574745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1012/2028] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:31 2022] DELETE /identity/v3/users/0080fc96d28c481d96b90554adc8684a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:31.580210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba5e0-a73c-4892-91ea-b3ec4c50b37d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.580859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba5e0-a73c-4892-91ea-b3ec4c50b37d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.581315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba5e0-a73c-4892-91ea-b3ec4c50b37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.601094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1017/2029] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:31 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:31.605362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.607135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-30dba5e0-a73c-4892-91ea-b3ec4c50b37d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:31.608028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:31.609136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-30dba5e0-a73c-4892-91ea-b3ec4c50b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:31.684162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1013/2030] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:31.696421 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba5e0-a73c-4892-91ea-b3ec4c50b37d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.698701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-30dba5e0-a73c-4892-91ea-b3ec4c50b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:31.701686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6be74-4a79-473b-a713-2742ae4ee8e9 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.707682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93365-73f1-4d72-a91c-014597de5410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.708609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93365-73f1-4d72-a91c-014597de5410 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.708980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93365-73f1-4d72-a91c-014597de5410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.709339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93365-73f1-4d72-a91c-014597de5410 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.710116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93365-73f1-4d72-a91c-014597de5410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.712198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93365-73f1-4d72-a91c-014597de5410 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.737870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1018/2031] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:31 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:31.742061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93365-73f1-4d72-a91c-014597de5410 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.756286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93365-73f1-4d72-a91c-014597de5410 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.762120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfa58-18a0-4598-88b2-63b766bd227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.763104 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfa58-18a0-4598-88b2-63b766bd227d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.763472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfa58-18a0-4598-88b2-63b766bd227d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.764172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfa58-18a0-4598-88b2-63b766bd227d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.765717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bfa58-18a0-4598-88b2-63b766bd227d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.767784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bfa58-18a0-4598-88b2-63b766bd227d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.776847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba5e0-a73c-4892-91ea-b3ec4c50b37d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.780380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1019/2032] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:31.781331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c428b-15b2-4e1c-acd1-89aeab83abed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.782389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c428b-15b2-4e1c-acd1-89aeab83abed service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.782389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c428b-15b2-4e1c-acd1-89aeab83abed service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.782705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c428b-15b2-4e1c-acd1-89aeab83abed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.784804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfa58-18a0-4598-88b2-63b766bd227d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.794712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c428b-15b2-4e1c-acd1-89aeab83abed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.796335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c428b-15b2-4e1c-acd1-89aeab83abed service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.797351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfa58-18a0-4598-88b2-63b766bd227d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.802825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d570d3-c284-402a-a1cc-cc91c8687a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.803726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d570d3-c284-402a-a1cc-cc91c8687a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.804094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d570d3-c284-402a-a1cc-cc91c8687a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.804591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d570d3-c284-402a-a1cc-cc91c8687a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.805341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d570d3-c284-402a-a1cc-cc91c8687a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.807173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d570d3-c284-402a-a1cc-cc91c8687a6f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.820602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1014/2033] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:31.823941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1020/2034] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:31.828821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c428b-15b2-4e1c-acd1-89aeab83abed service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:31.850585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c428b-15b2-4e1c-acd1-89aeab83abed service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:31.856578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695fd0-b1df-47db-9336-6785d839b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:31.858216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695fd0-b1df-47db-9336-6785d839b7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.859111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695fd0-b1df-47db-9336-6785d839b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.859519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695fd0-b1df-47db-9336-6785d839b7a3 admin admin] PATH_INFO: `/v3/projects/8309da8ef56c45e289c57af62ac556b4/users/9a6c0683b5954ccb9ede407e97099045/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.884640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695fd0-b1df-47db-9336-6785d839b7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8309da8ef56c45e289c57af62ac556b4, user_id=9a6c0683b5954ccb9ede407e97099045, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:31.887600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695fd0-b1df-47db-9336-6785d839b7a3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:31.912146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1015/2035] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:31 2022] PUT /identity/v3/projects/8309da8ef56c45e289c57af62ac556b4/users/9a6c0683b5954ccb9ede407e97099045/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:31.925586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96886e91-9715-45b9-b52d-5b11097351c8 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:31.925921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96886e91-9715-45b9-b52d-5b11097351c8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:31.926590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96886e91-9715-45b9-b52d-5b11097351c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:31.962631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-96886e91-9715-45b9-b52d-5b11097351c8 None None] MFA Rules not processed for user `9a6c0683b5954ccb9ede407e97099045`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:31.964520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-96886e91-9715-45b9-b52d-5b11097351c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:32.005432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:32.062930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1021/2036] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:32.066357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695fd0-b1df-47db-9336-6785d839b7a3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.154854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695fd0-b1df-47db-9336-6785d839b7a3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.160144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.160955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.161345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.161721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.162807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.164566 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.194625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1016/2037] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:32 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:32.200271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96886e91-9715-45b9-b52d-5b11097351c8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.210976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96886e91-9715-45b9-b52d-5b11097351c8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.231785 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.234851 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:32.241415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:32.305885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7ca2-6c9d-46ec-8eae-90e8f828da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.307484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7ca2-6c9d-46ec-8eae-90e8f828da3c admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.307708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7ca2-6c9d-46ec-8eae-90e8f828da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.309260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7ca2-6c9d-46ec-8eae-90e8f828da3c admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.310826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7ca2-6c9d-46ec-8eae-90e8f828da3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.315565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7ca2-6c9d-46ec-8eae-90e8f828da3c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.325444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff383517-d988-4f7b-8976-02c434884e91 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.332715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.333653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.333983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.334313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] PATH_INFO: `/v3/projects/87cfc720cba445c5973859341b4c390d` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.335716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cfc720cba445c5973859341b4c390d)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.337773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.347963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1022/2038] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:32 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:32.350028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7ca2-6c9d-46ec-8eae-90e8f828da3c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.363483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7ca2-6c9d-46ec-8eae-90e8f828da3c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.375715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6ece6-f0d7-4fdc-a7d8-8ccb60fb981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.376281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ece6-f0d7-4fdc-a7d8-8ccb60fb981f admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.376655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ece6-f0d7-4fdc-a7d8-8ccb60fb981f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.377002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ece6-f0d7-4fdc-a7d8-8ccb60fb981f admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.378087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6ece6-f0d7-4fdc-a7d8-8ccb60fb981f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.379617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6ece6-f0d7-4fdc-a7d8-8ccb60fb981f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.399071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1023/2039] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:32.400041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6ece6-f0d7-4fdc-a7d8-8ccb60fb981f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.420221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6ece6-f0d7-4fdc-a7d8-8ccb60fb981f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.424843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cfc720cba445c5973859341b4c390d', 'request_id': 'req-53e10f52-ab46-4555-982f-ef0fd2cadcaf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.435461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cfc720cba445c5973859341b4c390d', 'request_id': 'req-53e10f52-ab46-4555-982f-ef0fd2cadcaf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.444057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cfc720cba445c5973859341b4c390d', 'request_id': 'req-53e10f52-ab46-4555-982f-ef0fd2cadcaf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.463492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] The token cache is being invalidate because project 87cfc720cba445c5973859341b4c390d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:32.463881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.464633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.466854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1017/2040] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:32 2022] DELETE /identity/v3/projects/87cfc720cba445c5973859341b4c390d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:32.476054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.488889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:32.524188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.525342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.525716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.526067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] PATH_INFO: `/v3/projects/726a30c1be5e4f88835abba71828d90a/users/be3adb5689874309bd005e9e696c622e/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.544357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=726a30c1be5e4f88835abba71828d90a, user_id=be3adb5689874309bd005e9e696c622e, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.548661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.569661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1024/2041] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:32 2022] PUT /identity/v3/projects/726a30c1be5e4f88835abba71828d90a/users/be3adb5689874309bd005e9e696c622e/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:32.573224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.576200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:32.579488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e10f52-ab46-4555-982f-ef0fd2cadcaf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.628500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:32.632848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:32.657178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4b2b0-c5f8-46e4-92bd-0c24a14dd92d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.660637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.661629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.662005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.662352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] PATH_INFO: `/v3/users/6116b18d4c8e41289b1d92bbcaaa2cd2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.663662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee4d69-31d0-47fc-9b19-820e53fd8f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.663820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6116b18d4c8e41289b1d92bbcaaa2cd2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.664822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee4d69-31d0-47fc-9b19-820e53fd8f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.665257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee4d69-31d0-47fc-9b19-820e53fd8f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.665680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee4d69-31d0-47fc-9b19-820e53fd8f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.666040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.666802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee4d69-31d0-47fc-9b19-820e53fd8f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.668768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee4d69-31d0-47fc-9b19-820e53fd8f36 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.681016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1025/2042] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:32.684746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee4d69-31d0-47fc-9b19-820e53fd8f36 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.695949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee4d69-31d0-47fc-9b19-820e53fd8f36 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.701785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9a9b1-4c0c-410c-9dfc-b1f7981640ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.703788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9a9b1-4c0c-410c-9dfc-b1f7981640ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.704381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9a9b1-4c0c-410c-9dfc-b1f7981640ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.704818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9a9b1-4c0c-410c-9dfc-b1f7981640ef admin admin] PATH_INFO: `/v3/projects/726a30c1be5e4f88835abba71828d90a/users/be3adb5689874309bd005e9e696c622e/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.707151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9a9b1-4c0c-410c-9dfc-b1f7981640ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=726a30c1be5e4f88835abba71828d90a, user_id=be3adb5689874309bd005e9e696c622e, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.710355 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9a9b1-4c0c-410c-9dfc-b1f7981640ef admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.724166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1026/2043] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:32 2022] PUT /identity/v3/projects/726a30c1be5e4f88835abba71828d90a/users/be3adb5689874309bd005e9e696c622e/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:32.732005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6116b18d4c8e41289b1d92bbcaaa2cd2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.734198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9b90-a282-40d5-8eb8-4b7a37e0f1c2 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.734996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9b90-a282-40d5-8eb8-4b7a37e0f1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.735263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6116b18d4c8e41289b1d92bbcaaa2cd2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.735659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9b90-a282-40d5-8eb8-4b7a37e0f1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.746365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6116b18d4c8e41289b1d92bbcaaa2cd2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.754222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6116b18d4c8e41289b1d92bbcaaa2cd2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.776459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d63a9b90-a282-40d5-8eb8-4b7a37e0f1c2 None None] MFA Rules not processed for user `be3adb5689874309bd005e9e696c622e`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:32.776781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6116b18d4c8e41289b1d92bbcaaa2cd2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:32.779085 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d63a9b90-a282-40d5-8eb8-4b7a37e0f1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:32.785755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1018/2044] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:32 2022] DELETE /identity/v3/users/6116b18d4c8e41289b1d92bbcaaa2cd2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:32.902789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1027/2045] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:32.911673 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.914045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:33.010866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce178a6b-4b5f-4f5c-9c24-b9ded1a5ab37 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:33.016176 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457124-8f68-4064-a764-c38a39c6a463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:33.017093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457124-8f68-4064-a764-c38a39c6a463 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:33.017487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457124-8f68-4064-a764-c38a39c6a463 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:33.018090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457124-8f68-4064-a764-c38a39c6a463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:33.124710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90457124-8f68-4064-a764-c38a39c6a463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:33.126449 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90457124-8f68-4064-a764-c38a39c6a463 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:33.141425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1019/2046] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:33.178844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a9b90-a282-40d5-8eb8-4b7a37e0f1c2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:33.181233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d63a9b90-a282-40d5-8eb8-4b7a37e0f1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:33.297500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a9b90-a282-40d5-8eb8-4b7a37e0f1c2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:33.377803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:33.391600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:33.392867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:33.393393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:33.393744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] PATH_INFO: `/v3/projects/cbed3257deda4d3d9ab2154b795450c0` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:33.395343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbed3257deda4d3d9ab2154b795450c0)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:33.397497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:33.463245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbed3257deda4d3d9ab2154b795450c0', 'request_id': 'req-db16109f-9f87-4b9c-a7e2-efb73852b1e7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.471833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbed3257deda4d3d9ab2154b795450c0', 'request_id': 'req-db16109f-9f87-4b9c-a7e2-efb73852b1e7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.480875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbed3257deda4d3d9ab2154b795450c0', 'request_id': 'req-db16109f-9f87-4b9c-a7e2-efb73852b1e7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.502160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] The token cache is being invalidate because project cbed3257deda4d3d9ab2154b795450c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:33.502280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.502981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.505001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1028/2047] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:33 2022] DELETE /identity/v3/projects/cbed3257deda4d3d9ab2154b795450c0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:33.509135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457124-8f68-4064-a764-c38a39c6a463 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:33.547880 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457124-8f68-4064-a764-c38a39c6a463 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:33.583163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:33.661327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:33.662230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:33.662515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:33.663168 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] PATH_INFO: `/v3/users/14426ef5fd2c4bc39b6909ad2f8df161` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:33.664041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14426ef5fd2c4bc39b6909ad2f8df161)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:33.666535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:33.730276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14426ef5fd2c4bc39b6909ad2f8df161'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.730671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14426ef5fd2c4bc39b6909ad2f8df161'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.742690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14426ef5fd2c4bc39b6909ad2f8df161'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.766598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14426ef5fd2c4bc39b6909ad2f8df161'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.778023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c2b89f54-ab67-414c-8bef-512594621636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14426ef5fd2c4bc39b6909ad2f8df161'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:33.791162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1020/2048] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:33 2022] DELETE /identity/v3/users/14426ef5fd2c4bc39b6909ad2f8df161 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:34.075686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:34.077339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:34.098643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16109f-9f87-4b9c-a7e2-efb73852b1e7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:34.201362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:34.203161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.203282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.203670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] PATH_INFO: `/v3/users/9a6c0683b5954ccb9ede407e97099045` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.205027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6c0683b5954ccb9ede407e97099045)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:34.207148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:34.273980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6c0683b5954ccb9ede407e97099045'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.292147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6c0683b5954ccb9ede407e97099045'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.292927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6c0683b5954ccb9ede407e97099045'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.305262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6c0683b5954ccb9ede407e97099045'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.317380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6c0683b5954ccb9ede407e97099045'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.338527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1029/2049] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:34 2022] DELETE /identity/v3/users/9a6c0683b5954ccb9ede407e97099045 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:34.345813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d0cc-18fa-4978-ae04-33c215798720 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.346118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d0cc-18fa-4978-ae04-33c215798720 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.346439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d0cc-18fa-4978-ae04-33c215798720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.372561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b8e4d0cc-18fa-4978-ae04-33c215798720 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:34.373922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b8e4d0cc-18fa-4978-ae04-33c215798720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:34.471311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1021/2050] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:34.500526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:34.502190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:34.508172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:34.522976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb0468-aa9a-4b3c-b329-ca9cd2424818 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.523500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb0468-aa9a-4b3c-b329-ca9cd2424818 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.523500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb0468-aa9a-4b3c-b329-ca9cd2424818 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.525234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1022/2051] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:34:34.537582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a4e6-0d15-4fe3-901d-0b6a9769fa03 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.538635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a4e6-0d15-4fe3-901d-0b6a9769fa03 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.539214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a4e6-0d15-4fe3-901d-0b6a9769fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.585341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d7e4a4e6-0d15-4fe3-901d-0b6a9769fa03 None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:34.586750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d7e4a4e6-0d15-4fe3-901d-0b6a9769fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:34.588512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8aae6-3d84-406e-b08e-d8542abeb32f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:34.592304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:34.593908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.593908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.594243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.605186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:34.607060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:34.618565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1030/2052] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:34.649496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:34.675544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:34.677516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:34.704291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf1377-6eb2-4b3d-98f5-78bc41df8097 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:34.715157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:34.716407 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.716705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.717468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] PATH_INFO: `/v3/users/a0794c7a4d5e416caccfa3bd6ce5ea17` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.720535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1023/2053] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:34:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:34.721176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0794c7a4d5e416caccfa3bd6ce5ea17)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:34.723229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:34.745370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4a4e6-0d15-4fe3-901d-0b6a9769fa03 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:34.748511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d7e4a4e6-0d15-4fe3-901d-0b6a9769fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:34.769523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4a4e6-0d15-4fe3-901d-0b6a9769fa03 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:34.781186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:34.783053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.783757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.783966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.796498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:34.798156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:34.811847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1024/2054] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:34.812953 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:34.814330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:34.841212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349891f-4937-4e81-bb15-9f8f6c31c384 service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:34.848217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:34.849329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.849440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.849702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] PATH_INFO: `/v3/projects/3321254bbf07486184bc3c42df50730e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.851197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3321254bbf07486184bc3c42df50730e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:34.851784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0794c7a4d5e416caccfa3bd6ce5ea17'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.853693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:34.882062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0794c7a4d5e416caccfa3bd6ce5ea17'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.882949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0794c7a4d5e416caccfa3bd6ce5ea17'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.896491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0794c7a4d5e416caccfa3bd6ce5ea17'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.905320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e88be6c8-6ea8-4024-9fea-53c239ad5c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0794c7a4d5e416caccfa3bd6ce5ea17'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.915063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1031/2055] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:34 2022] DELETE /identity/v3/users/a0794c7a4d5e416caccfa3bd6ce5ea17 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:34.919830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3321254bbf07486184bc3c42df50730e', 'request_id': 'req-3c633253-c176-4318-a0d0-411572274f46'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.931773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3321254bbf07486184bc3c42df50730e', 'request_id': 'req-3c633253-c176-4318-a0d0-411572274f46'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.941083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3321254bbf07486184bc3c42df50730e', 'request_id': 'req-3c633253-c176-4318-a0d0-411572274f46'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.963220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] The token cache is being invalidate because project 3321254bbf07486184bc3c42df50730e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:34.963622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.964457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:34.968965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1025/2056] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:34 2022] DELETE /identity/v3/projects/3321254bbf07486184bc3c42df50730e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:34.973680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092bb75-8ac8-418c-a32b-33f0ae48f321 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:34.973975 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092bb75-8ac8-418c-a32b-33f0ae48f321 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:34.974284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092bb75-8ac8-418c-a32b-33f0ae48f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:34.997765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.000430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.004655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a092bb75-8ac8-418c-a32b-33f0ae48f321 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:35.005907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a092bb75-8ac8-418c-a32b-33f0ae48f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.121123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1032/2057] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:35.130303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3378c-cc21-4da9-83d3-664aba774fcc None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.130810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3378c-cc21-4da9-83d3-664aba774fcc None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.131633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3378c-cc21-4da9-83d3-664aba774fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.168491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-37c3378c-cc21-4da9-83d3-664aba774fcc None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:35.170394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-37c3378c-cc21-4da9-83d3-664aba774fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.185529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1033/2058] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:35.187734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633253-c176-4318-a0d0-411572274f46 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.188376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3378c-cc21-4da9-83d3-664aba774fcc None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.190131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-37c3378c-cc21-4da9-83d3-664aba774fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.209525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.210426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.210763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.211117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] PATH_INFO: `/v3/projects/8309da8ef56c45e289c57af62ac556b4` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.212516 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8309da8ef56c45e289c57af62ac556b4)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.213921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3378c-cc21-4da9-83d3-664aba774fcc None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.215091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.223940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.225337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.225679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.226019 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] PATH_INFO: `/v3/projects/fc4a4f6af6ea405fac0ee8fb191d41ff` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.227860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4a4f6af6ea405fac0ee8fb191d41ff)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.231000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.244139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:35.302384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:35.313961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8309da8ef56c45e289c57af62ac556b4', 'request_id': 'req-e1281f05-339d-4e2d-bf72-6697393331d2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.322199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8309da8ef56c45e289c57af62ac556b4', 'request_id': 'req-e1281f05-339d-4e2d-bf72-6697393331d2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.330504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4a4f6af6ea405fac0ee8fb191d41ff', 'request_id': 'req-500cd968-4cff-4e73-a63f-8f9c83f2e84c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.337932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8309da8ef56c45e289c57af62ac556b4', 'request_id': 'req-e1281f05-339d-4e2d-bf72-6697393331d2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.340521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4a4f6af6ea405fac0ee8fb191d41ff', 'request_id': 'req-500cd968-4cff-4e73-a63f-8f9c83f2e84c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.350650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4a4f6af6ea405fac0ee8fb191d41ff', 'request_id': 'req-500cd968-4cff-4e73-a63f-8f9c83f2e84c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.362401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] The token cache is being invalidate because project 8309da8ef56c45e289c57af62ac556b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:35.362760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.363844 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.366496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1026/2059] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:34 2022] DELETE /identity/v3/projects/8309da8ef56c45e289c57af62ac556b4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:35.367310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.368608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.379063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] The token cache is being invalidate because project fc4a4f6af6ea405fac0ee8fb191d41ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:35.379327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.380279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.382102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1034/2060] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:35 2022] DELETE /identity/v3/projects/fc4a4f6af6ea405fac0ee8fb191d41ff => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:35.382612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.386327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.451226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281f05-339d-4e2d-bf72-6697393331d2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.469413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cd968-4cff-4e73-a63f-8f9c83f2e84c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.475794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.476697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.476988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.477397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] PATH_INFO: `/v3/users/be3adb5689874309bd005e9e696c622e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.478843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3adb5689874309bd005e9e696c622e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.480855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.519451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66860-2bbb-4ff1-bb88-0b74f169eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.520150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66860-2bbb-4ff1-bb88-0b74f169eead admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.520474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66860-2bbb-4ff1-bb88-0b74f169eead admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.520870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66860-2bbb-4ff1-bb88-0b74f169eead admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.521567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b66860-2bbb-4ff1-bb88-0b74f169eead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:35.521904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b66860-2bbb-4ff1-bb88-0b74f169eead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.523645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b66860-2bbb-4ff1-bb88-0b74f169eead admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.537493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3adb5689874309bd005e9e696c622e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.537999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1027/2061] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:35.539162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d613e-a102-4c63-8cad-20971b5379a8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.539431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d613e-a102-4c63-8cad-20971b5379a8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.539834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d613e-a102-4c63-8cad-20971b5379a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.554656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3adb5689874309bd005e9e696c622e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.555482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3adb5689874309bd005e9e696c622e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.559536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b26d613e-a102-4c63-8cad-20971b5379a8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:35.561000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b26d613e-a102-4c63-8cad-20971b5379a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.564551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3adb5689874309bd005e9e696c622e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.569725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1028/2062] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:35.573383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-3bc56a30-fe50-4101-b647-ac41056a8537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3adb5689874309bd005e9e696c622e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:35.575641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d613e-a102-4c63-8cad-20971b5379a8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.577042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b26d613e-a102-4c63-8cad-20971b5379a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.586836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1035/2063] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:35 2022] DELETE /identity/v3/users/be3adb5689874309bd005e9e696c622e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:35.588264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fb7d-ab22-42ff-9c08-0e9fddedf369 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.588564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fb7d-ab22-42ff-9c08-0e9fddedf369 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.588995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fb7d-ab22-42ff-9c08-0e9fddedf369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.591675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d613e-a102-4c63-8cad-20971b5379a8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.610293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-3170fb7d-ab22-42ff-9c08-0e9fddedf369 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:35.611616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3170fb7d-ab22-42ff-9c08-0e9fddedf369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.628634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:35.676866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7046-c3ca-45a5-a6bb-7af338183c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.678008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7046-c3ca-45a5-a6bb-7af338183c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.678401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7046-c3ca-45a5-a6bb-7af338183c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.678894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7046-c3ca-45a5-a6bb-7af338183c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.679841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba7046-c3ca-45a5-a6bb-7af338183c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.682096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba7046-c3ca-45a5-a6bb-7af338183c2f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.686132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:35.739662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1029/2064] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:35 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:35.741258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7046-c3ca-45a5-a6bb-7af338183c2f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.763538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1036/2065] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:35.767893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fb7d-ab22-42ff-9c08-0e9fddedf369 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.786289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fb7d-ab22-42ff-9c08-0e9fddedf369 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.855208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7046-c3ca-45a5-a6bb-7af338183c2f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.860555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91754f-51d9-4e3c-850d-7fcb74b69fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.861873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91754f-51d9-4e3c-850d-7fcb74b69fad admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.862135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91754f-51d9-4e3c-850d-7fcb74b69fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.862722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91754f-51d9-4e3c-850d-7fcb74b69fad admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.863488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91754f-51d9-4e3c-850d-7fcb74b69fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.865881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91754f-51d9-4e3c-850d-7fcb74b69fad admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.872404 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.873084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.873542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.873919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.875123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:35.876105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.877888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.890329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1030/2066] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:35 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:35.891040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1037/2067] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:34:35.893957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91754f-51d9-4e3c-850d-7fcb74b69fad admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.895205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.903959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91754f-51d9-4e3c-850d-7fcb74b69fad admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.908134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e912-b71f-4832-bc5c-ff786d8833d2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.910304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265322d-4ecd-4aa5-ae1d-9136b21ff49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.911148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265322d-4ecd-4aa5-ae1d-9136b21ff49b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.911445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265322d-4ecd-4aa5-ae1d-9136b21ff49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.911730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265322d-4ecd-4aa5-ae1d-9136b21ff49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.912464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265322d-4ecd-4aa5-ae1d-9136b21ff49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.914135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265322d-4ecd-4aa5-ae1d-9136b21ff49b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.914813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaa38a-39b9-4a60-836b-7c590b5f48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.915495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa38a-39b9-4a60-836b-7c590b5f48e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.915795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa38a-39b9-4a60-836b-7c590b5f48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.916079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa38a-39b9-4a60-836b-7c590b5f48e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.916898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaa38a-39b9-4a60-836b-7c590b5f48e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.918698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaa38a-39b9-4a60-836b-7c590b5f48e0 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.928791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1031/2068] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:35.933814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265322d-4ecd-4aa5-ae1d-9136b21ff49b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.945312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265322d-4ecd-4aa5-ae1d-9136b21ff49b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.950057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3dd83-f706-4d9c-8189-b268bc468085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.950412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1038/2069] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:35 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:35.951184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3dd83-f706-4d9c-8189-b268bc468085 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.951184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3dd83-f706-4d9c-8189-b268bc468085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.951387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3dd83-f706-4d9c-8189-b268bc468085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.952855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3dd83-f706-4d9c-8189-b268bc468085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.954625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3dd83-f706-4d9c-8189-b268bc468085 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.954754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaa38a-39b9-4a60-836b-7c590b5f48e0 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.967420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1032/2070] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:35.972471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3dd83-f706-4d9c-8189-b268bc468085 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.985690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3dd83-f706-4d9c-8189-b268bc468085 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.033882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaa38a-39b9-4a60-836b-7c590b5f48e0 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.038556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.039283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.039654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.040262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.040710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.042901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.055453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4641-753f-4bed-b30c-70c94737b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.056541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4641-753f-4bed-b30c-70c94737b332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.056837 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4641-753f-4bed-b30c-70c94737b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.057244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4641-753f-4bed-b30c-70c94737b332 admin admin] PATH_INFO: `/v3/projects/2c9c7cb6658149109f94420a66b7961c/users/32971b64c80e494c935b097e92679a1a/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.074112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1039/2071] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:35 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:36.074710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4641-753f-4bed-b30c-70c94737b332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9c7cb6658149109f94420a66b7961c, user_id=32971b64c80e494c935b097e92679a1a, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.075307 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.077639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.078127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4641-753f-4bed-b30c-70c94737b332 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.091350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f41f7-ec39-4250-9d64-32d2d49ab22c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.095208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1033/2072] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:35 2022] PUT /identity/v3/projects/2c9c7cb6658149109f94420a66b7961c/users/32971b64c80e494c935b097e92679a1a/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:36.096489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4641-753f-4bed-b30c-70c94737b332 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.116595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:36.145163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:36.172027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4641-753f-4bed-b30c-70c94737b332 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.176389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.177284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.177574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.177813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5237114-0b2d-4991-b27a-976edbe04dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.177935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] PATH_INFO: `/v3/projects/726a30c1be5e4f88835abba71828d90a` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.178493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237114-0b2d-4991-b27a-976edbe04dff admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.178826 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237114-0b2d-4991-b27a-976edbe04dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.179082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=726a30c1be5e4f88835abba71828d90a)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.179184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237114-0b2d-4991-b27a-976edbe04dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.179872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5237114-0b2d-4991-b27a-976edbe04dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.181066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.181455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5237114-0b2d-4991-b27a-976edbe04dff admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.193927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1034/2073] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:36.195273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fab31-bb3d-46ac-9e2a-aa043d222dcb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.195703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fab31-bb3d-46ac-9e2a-aa043d222dcb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.196000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fab31-bb3d-46ac-9e2a-aa043d222dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.227558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-929fab31-bb3d-46ac-9e2a-aa043d222dcb None None] MFA Rules not processed for user `32971b64c80e494c935b097e92679a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:36.229167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-929fab31-bb3d-46ac-9e2a-aa043d222dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.255272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726a30c1be5e4f88835abba71828d90a', 'request_id': 'req-a3131840-2695-4473-9ee9-719a5c80e91b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:36.267516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726a30c1be5e4f88835abba71828d90a', 'request_id': 'req-a3131840-2695-4473-9ee9-719a5c80e91b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:36.275007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726a30c1be5e4f88835abba71828d90a', 'request_id': 'req-a3131840-2695-4473-9ee9-719a5c80e91b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:36.317741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1035/2074] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:36.317741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fab31-bb3d-46ac-9e2a-aa043d222dcb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.332509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] The token cache is being invalidate because project 726a30c1be5e4f88835abba71828d90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:36.333286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:36.334178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:36.336865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1040/2075] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:36 2022] DELETE /identity/v3/projects/726a30c1be5e4f88835abba71828d90a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:36.343103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.344649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.397134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fab31-bb3d-46ac-9e2a-aa043d222dcb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.405852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e61a62-5ba5-468f-b4f7-899436ff9946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.406988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61a62-5ba5-468f-b4f7-899436ff9946 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.407731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61a62-5ba5-468f-b4f7-899436ff9946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.409218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61a62-5ba5-468f-b4f7-899436ff9946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.410161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e61a62-5ba5-468f-b4f7-899436ff9946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.411968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e61a62-5ba5-468f-b4f7-899436ff9946 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.422048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3131840-2695-4473-9ee9-719a5c80e91b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.428520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1036/2076] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:36.428520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea642c5-842f-421c-b8af-f69168c64a99 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.428520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea642c5-842f-421c-b8af-f69168c64a99 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.428520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea642c5-842f-421c-b8af-f69168c64a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.432253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d585222-f09b-4733-8e75-3b7c4c9e1b9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a81dce4c3ffd42bd85bf6e7687b5cbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.433009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585222-f09b-4733-8e75-3b7c4c9e1b9e service glance] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.433304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585222-f09b-4733-8e75-3b7c4c9e1b9e service glance] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.433595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585222-f09b-4733-8e75-3b7c4c9e1b9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.441110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2d585222-f09b-4733-8e75-3b7c4c9e1b9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.448627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0ea642c5-842f-421c-b8af-f69168c64a99 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:36.449372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0ea642c5-842f-421c-b8af-f69168c64a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.454382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d585222-f09b-4733-8e75-3b7c4c9e1b9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.455879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d585222-f09b-4733-8e75-3b7c4c9e1b9e service glance] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.464089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1037/2077] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:36.464973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea642c5-842f-421c-b8af-f69168c64a99 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.466417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0ea642c5-842f-421c-b8af-f69168c64a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.469343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1041/2078] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:36.472190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413a49-2343-4992-81b6-ab507adabd64 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.472488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413a49-2343-4992-81b6-ab507adabd64 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.472772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413a49-2343-4992-81b6-ab507adabd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.489796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea642c5-842f-421c-b8af-f69168c64a99 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.496223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-c1413a49-2343-4992-81b6-ab507adabd64 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:36.497446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c1413a49-2343-4992-81b6-ab507adabd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.510026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1042/2079] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:36.510911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e7523-223d-4970-809e-20a7566d0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.511991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7523-223d-4970-809e-20a7566d0ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.512480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7523-223d-4970-809e-20a7566d0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.512925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7523-223d-4970-809e-20a7566d0ce5 admin admin] PATH_INFO: `/v3/projects/bbe86bd602444742a3e3a7842dbd9b78/users/cd74ada9d7bf48d5a6dbf1396a648d6d/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.517043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1413a49-2343-4992-81b6-ab507adabd64 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.526422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1413a49-2343-4992-81b6-ab507adabd64 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.531422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7523-223d-4970-809e-20a7566d0ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe86bd602444742a3e3a7842dbd9b78, user_id=cd74ada9d7bf48d5a6dbf1396a648d6d, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.532394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.533072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.533358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.533893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.534629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:36.534980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.536439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7523-223d-4970-809e-20a7566d0ce5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.536568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.550482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1043/2080] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:34:36.554878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.560927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1038/2081] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:36 2022] PUT /identity/v3/projects/bbe86bd602444742a3e3a7842dbd9b78/users/cd74ada9d7bf48d5a6dbf1396a648d6d/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:36.566970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c5e8-724f-4c4c-a155-1cb0e0977268 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.567266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c5e8-724f-4c4c-a155-1cb0e0977268 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.567550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c5e8-724f-4c4c-a155-1cb0e0977268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.572347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b6ce8-bc03-48a1-9aea-1e8323a45eee admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.586391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bf41c5e8-724f-4c4c-a155-1cb0e0977268 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:36.587794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bf41c5e8-724f-4c4c-a155-1cb0e0977268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.607184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:36.617884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:36.646148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e1d2-2747-42a4-a21b-09cb92072322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.647132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e1d2-2747-42a4-a21b-09cb92072322 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.647482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e1d2-2747-42a4-a21b-09cb92072322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.647833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e1d2-2747-42a4-a21b-09cb92072322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.648598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e1d2-2747-42a4-a21b-09cb92072322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.650576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e1d2-2747-42a4-a21b-09cb92072322 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.662237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1039/2082] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:36.674425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41c5e8-724f-4c4c-a155-1cb0e0977268 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.676060 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bf41c5e8-724f-4c4c-a155-1cb0e0977268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:36.679568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1044/2083] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:36 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:36.683565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e1d2-2747-42a4-a21b-09cb92072322 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.742806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41c5e8-724f-4c4c-a155-1cb0e0977268 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.767081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e1d2-2747-42a4-a21b-09cb92072322 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.773122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a665b-af44-45f0-ab23-2b064ef03544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.774205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a665b-af44-45f0-ab23-2b064ef03544 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.774496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a665b-af44-45f0-ab23-2b064ef03544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.775186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a665b-af44-45f0-ab23-2b064ef03544 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.775900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a665b-af44-45f0-ab23-2b064ef03544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.778464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a665b-af44-45f0-ab23-2b064ef03544 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.799393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c15267-e3ed-4645-a864-e04632bfca58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.800069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c15267-e3ed-4645-a864-e04632bfca58 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.800452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c15267-e3ed-4645-a864-e04632bfca58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.801940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c15267-e3ed-4645-a864-e04632bfca58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.806844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1045/2084] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:36 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:36.808631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a665b-af44-45f0-ab23-2b064ef03544 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.820508 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a665b-af44-45f0-ab23-2b064ef03544 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.821173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c15267-e3ed-4645-a864-e04632bfca58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.823608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c15267-e3ed-4645-a864-e04632bfca58 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.826008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b079a1a-fee7-42e5-91ba-454047e6e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.827049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079a1a-fee7-42e5-91ba-454047e6e8de admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.827418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079a1a-fee7-42e5-91ba-454047e6e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.827777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079a1a-fee7-42e5-91ba-454047e6e8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.828590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b079a1a-fee7-42e5-91ba-454047e6e8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.830296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b079a1a-fee7-42e5-91ba-454047e6e8de admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.838957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1040/2085] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:36.843779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1046/2086] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:36.847683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c15267-e3ed-4645-a864-e04632bfca58 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.874134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c15267-e3ed-4645-a864-e04632bfca58 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.890681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39df8d-2377-4b15-986f-3d6858091223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.891641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39df8d-2377-4b15-986f-3d6858091223 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.891941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39df8d-2377-4b15-986f-3d6858091223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.892401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39df8d-2377-4b15-986f-3d6858091223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.893079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39df8d-2377-4b15-986f-3d6858091223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.894812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39df8d-2377-4b15-986f-3d6858091223 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:36.925536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1041/2087] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:36.929814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b079a1a-fee7-42e5-91ba-454047e6e8de admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:36.944772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b079a1a-fee7-42e5-91ba-454047e6e8de admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:36.958435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:36.959555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:36.960267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:36.960267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] PATH_INFO: `/v3/projects/d5a433204eee4691a39e24bf5fdadffe/users/f6c8f49e61ef477bafb6450711ae860a/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:36.978726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a433204eee4691a39e24bf5fdadffe, user_id=f6c8f49e61ef477bafb6450711ae860a, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:36.981552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:37.000593 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1047/2088] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:36 2022] PUT /identity/v3/projects/d5a433204eee4691a39e24bf5fdadffe/users/f6c8f49e61ef477bafb6450711ae860a/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:37.011889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b547-7574-4e7f-98a9-bd9bd7f5e1ef None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:37.012214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b547-7574-4e7f-98a9-bd9bd7f5e1ef None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:37.012556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b547-7574-4e7f-98a9-bd9bd7f5e1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:37.043762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-76f1b547-7574-4e7f-98a9-bd9bd7f5e1ef None None] MFA Rules not processed for user `f6c8f49e61ef477bafb6450711ae860a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:37.045008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-76f1b547-7574-4e7f-98a9-bd9bd7f5e1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:37.161177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1042/2089] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:37.182211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:37.184122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:37.253044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54dbf-b3cc-4469-a242-0c37c4b82e59 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:37.256702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee8522-b6e6-4eb4-948c-c325e4277921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:37.257368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee8522-b6e6-4eb4-948c-c325e4277921 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:37.257786 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee8522-b6e6-4eb4-948c-c325e4277921 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:37.258079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee8522-b6e6-4eb4-948c-c325e4277921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:37.267893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee8522-b6e6-4eb4-948c-c325e4277921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:37.269438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee8522-b6e6-4eb4-948c-c325e4277921 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:37.278875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1048/2090] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:37.664781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f4e1-ff1b-4dd7-b9f9-89fd772d0709 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:37.665427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f4e1-ff1b-4dd7-b9f9-89fd772d0709 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:37.665799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f4e1-ff1b-4dd7-b9f9-89fd772d0709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:37.673522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:37.700413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e231f4e1-ff1b-4dd7-b9f9-89fd772d0709 None None] MFA Rules not processed for user `cd74ada9d7bf48d5a6dbf1396a648d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:37.701856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e231f4e1-ff1b-4dd7-b9f9-89fd772d0709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:37.785817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1043/2091] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:37.790013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee8522-b6e6-4eb4-948c-c325e4277921 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:37.803519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:37.861222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee8522-b6e6-4eb4-948c-c325e4277921 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:37.865854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e3d16-4842-4675-96b0-3a97263efd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:37.866600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e3d16-4842-4675-96b0-3a97263efd07 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:37.866992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e3d16-4842-4675-96b0-3a97263efd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:37.867358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e3d16-4842-4675-96b0-3a97263efd07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:37.868152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e3d16-4842-4675-96b0-3a97263efd07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:37.870194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e3d16-4842-4675-96b0-3a97263efd07 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:37.895984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1049/2092] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:37 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:37.900042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231f4e1-ff1b-4dd7-b9f9-89fd772d0709 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:37.911394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231f4e1-ff1b-4dd7-b9f9-89fd772d0709 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:37.968761 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2e32f-5446-4205-ace3-1d4cc775e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:37.969431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e32f-5446-4205-ace3-1d4cc775e966 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:37.969748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e32f-5446-4205-ace3-1d4cc775e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:37.970032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e32f-5446-4205-ace3-1d4cc775e966 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:37.970714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2e32f-5446-4205-ace3-1d4cc775e966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:37.972656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2e32f-5446-4205-ace3-1d4cc775e966 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:37.992410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1044/2093] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:37 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:37.996377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e3d16-4842-4675-96b0-3a97263efd07 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:38.009028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e3d16-4842-4675-96b0-3a97263efd07 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:38.014607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037058-803d-488f-aca4-3f0bb42a0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:38.014906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037058-803d-488f-aca4-3f0bb42a0e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:38.015265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037058-803d-488f-aca4-3f0bb42a0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:38.015548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037058-803d-488f-aca4-3f0bb42a0e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:38.016283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1037058-803d-488f-aca4-3f0bb42a0e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:38.017973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1037058-803d-488f-aca4-3f0bb42a0e84 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:38.029237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1050/2094] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:38.033315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2e32f-5446-4205-ace3-1d4cc775e966 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:38.044359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2e32f-5446-4205-ace3-1d4cc775e966 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:38.049958 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399fe3-583a-4c64-a2d9-0d8ceba2f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:38.050959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399fe3-583a-4c64-a2d9-0d8ceba2f3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:38.051249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399fe3-583a-4c64-a2d9-0d8ceba2f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:38.051604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399fe3-583a-4c64-a2d9-0d8ceba2f3a6 admin admin] PATH_INFO: `/v3/projects/323d8ab9133943bab131c5ec3296be32/users/6be6f742315d470cb4ed02ce62f7ffff/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:38.068252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399fe3-583a-4c64-a2d9-0d8ceba2f3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323d8ab9133943bab131c5ec3296be32, user_id=6be6f742315d470cb4ed02ce62f7ffff, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:38.071088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399fe3-583a-4c64-a2d9-0d8ceba2f3a6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:38.084129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1045/2095] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:38 2022] PUT /identity/v3/projects/323d8ab9133943bab131c5ec3296be32/users/6be6f742315d470cb4ed02ce62f7ffff/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:38.088088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037058-803d-488f-aca4-3f0bb42a0e84 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:38.098179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037058-803d-488f-aca4-3f0bb42a0e84 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:38.153300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863ead9-40b0-44d5-b929-cc0803e670cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:38.153987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863ead9-40b0-44d5-b929-cc0803e670cc admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:38.154273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863ead9-40b0-44d5-b929-cc0803e670cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:38.155156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863ead9-40b0-44d5-b929-cc0803e670cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:38.155911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863ead9-40b0-44d5-b929-cc0803e670cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:38.159606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863ead9-40b0-44d5-b929-cc0803e670cc admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:38.169151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1051/2096] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:38.173824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399fe3-583a-4c64-a2d9-0d8ceba2f3a6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:38.184504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399fe3-583a-4c64-a2d9-0d8ceba2f3a6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:38.191552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3aa0a-adf0-45b7-9f7f-7af34265b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:38.192470 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aa0a-adf0-45b7-9f7f-7af34265b25a admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:38.192783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aa0a-adf0-45b7-9f7f-7af34265b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:38.193067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aa0a-adf0-45b7-9f7f-7af34265b25a admin admin] PATH_INFO: `/v3/projects/323d8ab9133943bab131c5ec3296be32/users/6be6f742315d470cb4ed02ce62f7ffff/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:38.195259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3aa0a-adf0-45b7-9f7f-7af34265b25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=323d8ab9133943bab131c5ec3296be32, user_id=6be6f742315d470cb4ed02ce62f7ffff, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:38.202130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3aa0a-adf0-45b7-9f7f-7af34265b25a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:38.216679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1046/2097] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:38 2022] PUT /identity/v3/projects/323d8ab9133943bab131c5ec3296be32/users/6be6f742315d470cb4ed02ce62f7ffff/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:38.931640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56506af2-e8a6-4bbf-9039-4b3aa3e2e5af None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:38.932324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56506af2-e8a6-4bbf-9039-4b3aa3e2e5af None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:38.932324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56506af2-e8a6-4bbf-9039-4b3aa3e2e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:38.964900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-56506af2-e8a6-4bbf-9039-4b3aa3e2e5af None None] MFA Rules not processed for user `6be6f742315d470cb4ed02ce62f7ffff`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:38.965644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-56506af2-e8a6-4bbf-9039-4b3aa3e2e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:39.073139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1052/2098] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:40.425446 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3aa0a-adf0-45b7-9f7f-7af34265b25a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:40.489079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:40.504484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3aa0a-adf0-45b7-9f7f-7af34265b25a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:40.510351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:40.511292 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:40.511763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:40.512192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] PATH_INFO: `/v3/users/cd74ada9d7bf48d5a6dbf1396a648d6d` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:40.513514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd74ada9d7bf48d5a6dbf1396a648d6d)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:40.515583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:40.569108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd74ada9d7bf48d5a6dbf1396a648d6d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:40.569861 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd74ada9d7bf48d5a6dbf1396a648d6d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:40.578130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd74ada9d7bf48d5a6dbf1396a648d6d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:40.585227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd74ada9d7bf48d5a6dbf1396a648d6d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:40.598356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd74ada9d7bf48d5a6dbf1396a648d6d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:40.605772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1047/2099] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:40 2022] DELETE /identity/v3/users/cd74ada9d7bf48d5a6dbf1396a648d6d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:40.960881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56506af2-e8a6-4bbf-9039-4b3aa3e2e5af None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:40.986674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56506af2-e8a6-4bbf-9039-4b3aa3e2e5af None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:40.992341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:41.073628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:41.074519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:41.074837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:41.075129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] PATH_INFO: `/v3/projects/bbe86bd602444742a3e3a7842dbd9b78` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:41.076375 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe86bd602444742a3e3a7842dbd9b78)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:41.078880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:41.133197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe86bd602444742a3e3a7842dbd9b78', 'request_id': 'req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.138668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe86bd602444742a3e3a7842dbd9b78', 'request_id': 'req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.145301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe86bd602444742a3e3a7842dbd9b78', 'request_id': 'req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.160804 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] The token cache is being invalidate because project bbe86bd602444742a3e3a7842dbd9b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:41.161184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.161845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.163998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1053/2100] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:40 2022] DELETE /identity/v3/projects/bbe86bd602444742a3e3a7842dbd9b78 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:41.168031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:41.169484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:41.183086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057806b-68f0-4aea-bc60-c0716d933e9c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:41.239381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:41.240265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:41.240554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:41.240835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] PATH_INFO: `/v3/users/6be6f742315d470cb4ed02ce62f7ffff` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:41.242025 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be6f742315d470cb4ed02ce62f7ffff)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:41.243965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:41.290138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be6f742315d470cb4ed02ce62f7ffff'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.290713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be6f742315d470cb4ed02ce62f7ffff'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.298235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be6f742315d470cb4ed02ce62f7ffff'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.308676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be6f742315d470cb4ed02ce62f7ffff'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.313893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:41.333937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c7f66caa-3452-420f-ad9d-3de642df6ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be6f742315d470cb4ed02ce62f7ffff'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.340345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1048/2101] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:41 2022] DELETE /identity/v3/users/6be6f742315d470cb4ed02ce62f7ffff => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:41.521212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:41.522815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:41.539853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29a0a-e53d-4a53-b590-ee9dd38bb4ae admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:41.604379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:41.605257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:41.605544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:41.605822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] PATH_INFO: `/v3/projects/323d8ab9133943bab131c5ec3296be32` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:41.607098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=323d8ab9133943bab131c5ec3296be32)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:41.609073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:41.656145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:41.668961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323d8ab9133943bab131c5ec3296be32', 'request_id': 'req-6e3f0004-b986-408a-b306-efdd16a63a7e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.676677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323d8ab9133943bab131c5ec3296be32', 'request_id': 'req-6e3f0004-b986-408a-b306-efdd16a63a7e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.683647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323d8ab9133943bab131c5ec3296be32', 'request_id': 'req-6e3f0004-b986-408a-b306-efdd16a63a7e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.700955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] The token cache is being invalidate because project 323d8ab9133943bab131c5ec3296be32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:41.701644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.703096 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6e3f0004-b986-408a-b306-efdd16a63a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:41.704665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1054/2102] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:41 2022] DELETE /identity/v3/projects/323d8ab9133943bab131c5ec3296be32 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:41.709755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b11a1-b153-4f17-b470-55c1f12d1f0c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:41.710256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b11a1-b153-4f17-b470-55c1f12d1f0c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:41.710556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b11a1-b153-4f17-b470-55c1f12d1f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:41.732256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e41b11a1-b153-4f17-b470-55c1f12d1f0c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:41.734016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e41b11a1-b153-4f17-b470-55c1f12d1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:41.827874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1049/2103] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:41.836886 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc4e6-14be-4085-925d-5fa96324fc14 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:41.837515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc4e6-14be-4085-925d-5fa96324fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:41.838139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc4e6-14be-4085-925d-5fa96324fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:41.861956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d28fc4e6-14be-4085-925d-5fa96324fc14 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:41.865714 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d28fc4e6-14be-4085-925d-5fa96324fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:41.874972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1055/2104] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:41.880053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b11a1-b153-4f17-b470-55c1f12d1f0c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:41.891163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b11a1-b153-4f17-b470-55c1f12d1f0c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:41.895970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:41.896654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:41.896939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:41.897217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:41.897964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:41.898870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:41.900244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:41.914884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1050/2105] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:41.919701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fc4e6-14be-4085-925d-5fa96324fc14 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:41.932396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fc4e6-14be-4085-925d-5fa96324fc14 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:41.940629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871cb2f-b1b5-468b-96b0-f2e58b0cc57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:41.941490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cb2f-b1b5-468b-96b0-f2e58b0cc57e admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:41.941780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cb2f-b1b5-468b-96b0-f2e58b0cc57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:41.942115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cb2f-b1b5-468b-96b0-f2e58b0cc57e admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:41.942971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871cb2f-b1b5-468b-96b0-f2e58b0cc57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:41.945016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871cb2f-b1b5-468b-96b0-f2e58b0cc57e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:41.987876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1056/2106] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:41 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:41.992833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.006218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b0a5-0606-4366-8328-b5496e46c18c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.118664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29632c-b4f6-4784-a01d-6dd6a671d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.119539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29632c-b4f6-4784-a01d-6dd6a671d364 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.119946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29632c-b4f6-4784-a01d-6dd6a671d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.120367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29632c-b4f6-4784-a01d-6dd6a671d364 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.121086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29632c-b4f6-4784-a01d-6dd6a671d364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.123097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29632c-b4f6-4784-a01d-6dd6a671d364 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.173570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1051/2107] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:41 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:42.180239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871cb2f-b1b5-468b-96b0-f2e58b0cc57e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.196870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871cb2f-b1b5-468b-96b0-f2e58b0cc57e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.202917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90d27c-2db7-4b3e-ac87-1f2deb882c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.203696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d27c-2db7-4b3e-ac87-1f2deb882c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.204021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d27c-2db7-4b3e-ac87-1f2deb882c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.204301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90d27c-2db7-4b3e-ac87-1f2deb882c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.205051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90d27c-2db7-4b3e-ac87-1f2deb882c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.207554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90d27c-2db7-4b3e-ac87-1f2deb882c82 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.222536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1057/2108] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:42.226549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29632c-b4f6-4784-a01d-6dd6a671d364 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.240005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29632c-b4f6-4784-a01d-6dd6a671d364 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.245018 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57cf70-e7c5-4ddd-b163-c48e4b5a731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.245693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cf70-e7c5-4ddd-b163-c48e4b5a731a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.245980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cf70-e7c5-4ddd-b163-c48e4b5a731a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.246265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cf70-e7c5-4ddd-b163-c48e4b5a731a admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.247035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57cf70-e7c5-4ddd-b163-c48e4b5a731a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.248729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57cf70-e7c5-4ddd-b163-c48e4b5a731a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.260351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1052/2109] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:42.264576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90d27c-2db7-4b3e-ac87-1f2deb882c82 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.275141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90d27c-2db7-4b3e-ac87-1f2deb882c82 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.280414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874f7d4-90d8-4403-8b86-0177de84d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.281323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874f7d4-90d8-4403-8b86-0177de84d67e admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.281612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874f7d4-90d8-4403-8b86-0177de84d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.281899 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874f7d4-90d8-4403-8b86-0177de84d67e admin admin] PATH_INFO: `/v3/projects/3fdf385012a7472099d32e26839f471e/users/10b2daca24894eba97bd5f74f7ff7f38/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.298982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874f7d4-90d8-4403-8b86-0177de84d67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdf385012a7472099d32e26839f471e, user_id=10b2daca24894eba97bd5f74f7ff7f38, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.301706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874f7d4-90d8-4403-8b86-0177de84d67e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.315868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1058/2110] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:42 2022] PUT /identity/v3/projects/3fdf385012a7472099d32e26839f471e/users/10b2daca24894eba97bd5f74f7ff7f38/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:42.326216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347671f-a776-4c62-b66d-1b9e015fe834 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.326525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347671f-a776-4c62-b66d-1b9e015fe834 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.326840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347671f-a776-4c62-b66d-1b9e015fe834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.358835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5347671f-a776-4c62-b66d-1b9e015fe834 None None] MFA Rules not processed for user `10b2daca24894eba97bd5f74f7ff7f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:42.360880 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5347671f-a776-4c62-b66d-1b9e015fe834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:42.402278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:42.430537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1053/2111] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:42.435070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874f7d4-90d8-4403-8b86-0177de84d67e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.505733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874f7d4-90d8-4403-8b86-0177de84d67e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.511200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c6faa-bc12-402c-bdea-d4a32bd09b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.511889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c6faa-bc12-402c-bdea-d4a32bd09b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.512176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c6faa-bc12-402c-bdea-d4a32bd09b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.512449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c6faa-bc12-402c-bdea-d4a32bd09b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.513143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c6faa-bc12-402c-bdea-d4a32bd09b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.515773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c6faa-bc12-402c-bdea-d4a32bd09b60 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.552049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1059/2112] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:42 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:42.554535 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347671f-a776-4c62-b66d-1b9e015fe834 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.565554 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347671f-a776-4c62-b66d-1b9e015fe834 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.630286 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2038b0e-dee4-4f01-b1e8-9cd99092dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.631324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038b0e-dee4-4f01-b1e8-9cd99092dda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.631710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038b0e-dee4-4f01-b1e8-9cd99092dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.632092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038b0e-dee4-4f01-b1e8-9cd99092dda2 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.633006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2038b0e-dee4-4f01-b1e8-9cd99092dda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.635290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2038b0e-dee4-4f01-b1e8-9cd99092dda2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.661136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1054/2113] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:42 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:42.662337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c6faa-bc12-402c-bdea-d4a32bd09b60 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.673139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c6faa-bc12-402c-bdea-d4a32bd09b60 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.677742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9149b-c407-473b-9b88-c1a8e8860dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.678408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9149b-c407-473b-9b88-c1a8e8860dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.678697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9149b-c407-473b-9b88-c1a8e8860dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.679008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9149b-c407-473b-9b88-c1a8e8860dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.679747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9149b-c407-473b-9b88-c1a8e8860dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.681376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9149b-c407-473b-9b88-c1a8e8860dd8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.691757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1060/2114] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:42.695839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2038b0e-dee4-4f01-b1e8-9cd99092dda2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.706238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2038b0e-dee4-4f01-b1e8-9cd99092dda2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.711080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.711965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.712252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.712533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] PATH_INFO: `/v3/projects/1ac304c2bd8d471c9b1c7e87721db943/users/6c0db96c66774c8e9ae63bc9740c4735/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.727472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac304c2bd8d471c9b1c7e87721db943, user_id=6c0db96c66774c8e9ae63bc9740c4735, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.730138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.743672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1055/2115] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:42 2022] PUT /identity/v3/projects/1ac304c2bd8d471c9b1c7e87721db943/users/6c0db96c66774c8e9ae63bc9740c4735/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:42.747869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9149b-c407-473b-9b88-c1a8e8860dd8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.760524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9149b-c407-473b-9b88-c1a8e8860dd8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.795501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:42.799807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.804735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:42.829452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2b728-621c-4bf2-977a-9959915b3d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.830078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2b728-621c-4bf2-977a-9959915b3d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.830372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2b728-621c-4bf2-977a-9959915b3d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.830672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2b728-621c-4bf2-977a-9959915b3d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.831445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2b728-621c-4bf2-977a-9959915b3d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.833100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2b728-621c-4bf2-977a-9959915b3d1d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.843759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1061/2116] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:42.847590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2b728-621c-4bf2-977a-9959915b3d1d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:42.857638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2b728-621c-4bf2-977a-9959915b3d1d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.862456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170b26-7506-4927-8405-231e960c66cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.863372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170b26-7506-4927-8405-231e960c66cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.863660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170b26-7506-4927-8405-231e960c66cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.863942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170b26-7506-4927-8405-231e960c66cc admin admin] PATH_INFO: `/v3/projects/1ac304c2bd8d471c9b1c7e87721db943/users/6c0db96c66774c8e9ae63bc9740c4735/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.865921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170b26-7506-4927-8405-231e960c66cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac304c2bd8d471c9b1c7e87721db943, user_id=6c0db96c66774c8e9ae63bc9740c4735, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.868613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170b26-7506-4927-8405-231e960c66cc admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.872111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d476-042d-4805-a950-38b5b40fbc9e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:42.877836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:42.878726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.879271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.879557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] PATH_INFO: `/v3/users/f6c8f49e61ef477bafb6450711ae860a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.879747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1062/2117] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:42 2022] PUT /identity/v3/projects/1ac304c2bd8d471c9b1c7e87721db943/users/6c0db96c66774c8e9ae63bc9740c4735/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:42.880812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c8f49e61ef477bafb6450711ae860a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:42.882843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:42.890762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da427-580a-4204-bcfd-713daa9f6d33 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.891087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da427-580a-4204-bcfd-713daa9f6d33 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.891376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da427-580a-4204-bcfd-713daa9f6d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:42.917858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-141da427-580a-4204-bcfd-713daa9f6d33 None None] MFA Rules not processed for user `6c0db96c66774c8e9ae63bc9740c4735`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:42.919126 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-141da427-580a-4204-bcfd-713daa9f6d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:42.937464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c8f49e61ef477bafb6450711ae860a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:42.938269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c8f49e61ef477bafb6450711ae860a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:42.940336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:42.946938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c8f49e61ef477bafb6450711ae860a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:42.956491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c8f49e61ef477bafb6450711ae860a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:42.969950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09851e9e-c54a-40ed-ba98-28acb6dc5587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c8f49e61ef477bafb6450711ae860a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:42.977838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1056/2118] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:42 2022] DELETE /identity/v3/users/f6c8f49e61ef477bafb6450711ae860a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:42.981955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41dddb-60bd-41bc-ba4e-8295633e1419 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:42.982355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41dddb-60bd-41bc-ba4e-8295633e1419 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:42.982721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41dddb-60bd-41bc-ba4e-8295633e1419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.001841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1063/2119] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:43.003698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cd41dddb-60bd-41bc-ba4e-8295633e1419 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:43.004992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cd41dddb-60bd-41bc-ba4e-8295633e1419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.013917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da427-580a-4204-bcfd-713daa9f6d33 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:43.015950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-141da427-580a-4204-bcfd-713daa9f6d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.067595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1057/2120] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:43.076785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da427-580a-4204-bcfd-713daa9f6d33 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:43.078074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41dddb-60bd-41bc-ba4e-8295633e1419 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:43.079700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cd41dddb-60bd-41bc-ba4e-8295633e1419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.133041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:43.133701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.133990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.134297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.139605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41dddb-60bd-41bc-ba4e-8295633e1419 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:43.144275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6717dbb-7ff7-45e9-bafd-838c9642d43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:43.144954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717dbb-7ff7-45e9-bafd-838c9642d43e service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.145242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717dbb-7ff7-45e9-bafd-838c9642d43e service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.145545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717dbb-7ff7-45e9-bafd-838c9642d43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.147750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:43.156580 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6717dbb-7ff7-45e9-bafd-838c9642d43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:43.158021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6717dbb-7ff7-45e9-bafd-838c9642d43e service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:43.168624 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1058/2121] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:43.204477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:43.205938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:43.244029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1064/2122] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:43.370925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6426db-e63c-42a2-aeff-8d44be55dcfd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.371523 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6426db-e63c-42a2-aeff-8d44be55dcfd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.371908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6426db-e63c-42a2-aeff-8d44be55dcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.404891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0d6426db-e63c-42a2-aeff-8d44be55dcfd None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:43.406155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0d6426db-e63c-42a2-aeff-8d44be55dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.507471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1059/2123] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:43.567227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:43.568767 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.596004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6426db-e63c-42a2-aeff-8d44be55dcfd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:43.598102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0d6426db-e63c-42a2-aeff-8d44be55dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.626152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6426db-e63c-42a2-aeff-8d44be55dcfd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:43.647921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:43.649015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.649627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf63fe-1af2-4923-894a-9b18fc524f8e service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:43.650077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.650439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] PATH_INFO: `/v3/projects/d5a433204eee4691a39e24bf5fdadffe` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.651931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a433204eee4691a39e24bf5fdadffe)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:43.654616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:43.656652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1cbab-6839-41b1-a0f6-bbac73e413d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:43.656961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1cbab-6839-41b1-a0f6-bbac73e413d4 service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.657404 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1cbab-6839-41b1-a0f6-bbac73e413d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.657779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1cbab-6839-41b1-a0f6-bbac73e413d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.671939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:43.673798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1cbab-6839-41b1-a0f6-bbac73e413d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:43.675910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1cbab-6839-41b1-a0f6-bbac73e413d4 service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:43.686130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1065/2124] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:34:43.731678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a433204eee4691a39e24bf5fdadffe', 'request_id': 'req-69d553fe-8733-4d14-9d88-6f346e8d9157'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:43.743417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a433204eee4691a39e24bf5fdadffe', 'request_id': 'req-69d553fe-8733-4d14-9d88-6f346e8d9157'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:43.752034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a433204eee4691a39e24bf5fdadffe', 'request_id': 'req-69d553fe-8733-4d14-9d88-6f346e8d9157'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:43.772629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] The token cache is being invalidate because project d5a433204eee4691a39e24bf5fdadffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:43.773200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:43.774011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:43.785719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1060/2125] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:43 2022] DELETE /identity/v3/projects/d5a433204eee4691a39e24bf5fdadffe => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:43.787981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f09b82-27cb-4242-a0ee-41ebab4d0c05 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.788287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f09b82-27cb-4242-a0ee-41ebab4d0c05 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.788628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f09b82-27cb-4242-a0ee-41ebab4d0c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.816633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d5f09b82-27cb-4242-a0ee-41ebab4d0c05 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:43.817999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d5f09b82-27cb-4242-a0ee-41ebab4d0c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.895322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:43.896943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.946981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1066/2126] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:43.956690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c481-3f1e-4daa-b68b-0512fc49ffd3 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.957456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c481-3f1e-4daa-b68b-0512fc49ffd3 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.957903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c481-3f1e-4daa-b68b-0512fc49ffd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.985317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d640c481-3f1e-4daa-b68b-0512fc49ffd3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:43.986689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d640c481-3f1e-4daa-b68b-0512fc49ffd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.001263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1067/2127] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:44.002327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c481-3f1e-4daa-b68b-0512fc49ffd3 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.002906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d553fe-8733-4d14-9d88-6f346e8d9157 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.008901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.010244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.010633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.011254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] PATH_INFO: `/v3/users/10b2daca24894eba97bd5f74f7ff7f38` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.012614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b2daca24894eba97bd5f74f7ff7f38)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.013005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c481-3f1e-4daa-b68b-0512fc49ffd3 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.015460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.019077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.019755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.020223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.020500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.021289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:44.021605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.023303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.042080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1068/2128] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:44.044528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.058249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95303e-aabb-4148-9128-b37590635244 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.063447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.064281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.064674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.065063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.065945 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.068612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.093017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b2daca24894eba97bd5f74f7ff7f38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.094313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b2daca24894eba97bd5f74f7ff7f38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.095892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:44.103220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b2daca24894eba97bd5f74f7ff7f38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.108008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1069/2129] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:44 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:44.109023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.111009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.112060 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b2daca24894eba97bd5f74f7ff7f38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.124897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e7ed6a8c-6b1e-44a7-9fb9-28d8346a1244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b2daca24894eba97bd5f74f7ff7f38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.131223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1061/2130] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:43 2022] DELETE /identity/v3/users/10b2daca24894eba97bd5f74f7ff7f38 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:44.135496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471ca9-a427-4cdc-b770-f0fcf645aaf3 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.135795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471ca9-a427-4cdc-b770-f0fcf645aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.136080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471ca9-a427-4cdc-b770-f0fcf645aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.154107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-aa471ca9-a427-4cdc-b770-f0fcf645aaf3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:44.155368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-aa471ca9-a427-4cdc-b770-f0fcf645aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.165632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:44.199855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6748e2-b458-47f6-99d0-3cf3b4119cc8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.226397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1062/2131] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:44.234934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa471ca9-a427-4cdc-b770-f0fcf645aaf3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.236309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-aa471ca9-a427-4cdc-b770-f0fcf645aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.267640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e4c2b-be2d-4081-9d54-f5081904ad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.268338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4c2b-be2d-4081-9d54-f5081904ad32 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.268632 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4c2b-be2d-4081-9d54-f5081904ad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.268915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4c2b-be2d-4081-9d54-f5081904ad32 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.269613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e4c2b-be2d-4081-9d54-f5081904ad32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.271593 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e4c2b-be2d-4081-9d54-f5081904ad32 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.294816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1070/2132] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:44 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:44.299080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e4c2b-be2d-4081-9d54-f5081904ad32 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.303230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa471ca9-a427-4cdc-b770-f0fcf645aaf3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.307428 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cbc9f-ead6-44c8-8ba0-d4c36f7904b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.308220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cbc9f-ead6-44c8-8ba0-d4c36f7904b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.308639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cbc9f-ead6-44c8-8ba0-d4c36f7904b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.308931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cbc9f-ead6-44c8-8ba0-d4c36f7904b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.309312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e4c2b-be2d-4081-9d54-f5081904ad32 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.315305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5f71e-a367-4a5c-9795-9da0df239bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.316110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5f71e-a367-4a5c-9795-9da0df239bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.316282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5f71e-a367-4a5c-9795-9da0df239bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.316527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5f71e-a367-4a5c-9795-9da0df239bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.317258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5f71e-a367-4a5c-9795-9da0df239bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.318910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5f71e-a367-4a5c-9795-9da0df239bd1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.322180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cbc9f-ead6-44c8-8ba0-d4c36f7904b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.323768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cbc9f-ead6-44c8-8ba0-d4c36f7904b6 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.330168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1071/2133] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:44.334374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5f71e-a367-4a5c-9795-9da0df239bd1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.337124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1063/2134] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:44.345175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5f71e-a367-4a5c-9795-9da0df239bd1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.349731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2ced-1b4a-4660-8ad7-afc5a4aeb502 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.350204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2ced-1b4a-4660-8ad7-afc5a4aeb502 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.350491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f2ced-1b4a-4660-8ad7-afc5a4aeb502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.351559 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fceacb-97d3-4fa7-9e21-1939a7b89600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.356064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fceacb-97d3-4fa7-9e21-1939a7b89600 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.356526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fceacb-97d3-4fa7-9e21-1939a7b89600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.356811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fceacb-97d3-4fa7-9e21-1939a7b89600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.357562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fceacb-97d3-4fa7-9e21-1939a7b89600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.359264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fceacb-97d3-4fa7-9e21-1939a7b89600 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.370437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1072/2135] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:44.373732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-456f2ced-1b4a-4660-8ad7-afc5a4aeb502 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:44.373732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-456f2ced-1b4a-4660-8ad7-afc5a4aeb502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.375742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fceacb-97d3-4fa7-9e21-1939a7b89600 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.386219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fceacb-97d3-4fa7-9e21-1939a7b89600 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.392502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c0ece-84ca-4918-8399-b5fafa3f1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.393519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c0ece-84ca-4918-8399-b5fafa3f1062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.393843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c0ece-84ca-4918-8399-b5fafa3f1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.394137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c0ece-84ca-4918-8399-b5fafa3f1062 admin admin] PATH_INFO: `/v3/projects/83603121771e4923b4de06f24a6400c0/users/195821093293441abe4768162a6fe5a7/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.411242 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c0ece-84ca-4918-8399-b5fafa3f1062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83603121771e4923b4de06f24a6400c0, user_id=195821093293441abe4768162a6fe5a7, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.413968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c0ece-84ca-4918-8399-b5fafa3f1062 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.427920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1073/2136] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:44 2022] PUT /identity/v3/projects/83603121771e4923b4de06f24a6400c0/users/195821093293441abe4768162a6fe5a7/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:44.432815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffa0f-fa43-414a-8637-43f7ccd7f627 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.433118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffa0f-fa43-414a-8637-43f7ccd7f627 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.433406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffa0f-fa43-414a-8637-43f7ccd7f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.445935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1064/2137] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jul 12 14:34:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:44.455966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-26bffa0f-fa43-414a-8637-43f7ccd7f627 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:44.457371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-26bffa0f-fa43-414a-8637-43f7ccd7f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.460651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f2ced-1b4a-4660-8ad7-afc5a4aeb502 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.462204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-456f2ced-1b4a-4660-8ad7-afc5a4aeb502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.519388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:44.554970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1074/2138] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:44.559301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f2ced-1b4a-4660-8ad7-afc5a4aeb502 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.567504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:44.569288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bffa0f-fa43-414a-8637-43f7ccd7f627 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.683479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bffa0f-fa43-414a-8637-43f7ccd7f627 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.688621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.689155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.689550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.689905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.703039 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2de8b0-8104-42bc-807e-6e3ead545f58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.703819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2de8b0-8104-42bc-807e-6e3ead545f58 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.704263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2de8b0-8104-42bc-807e-6e3ead545f58 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.704725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2de8b0-8104-42bc-807e-6e3ead545f58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.705374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.706918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.722858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1075/2139] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:44.724161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.725599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.751598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00f5f2-4b66-4ebd-8611-a97807e65e0c service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.758273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.759216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.759536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.759824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] PATH_INFO: `/v3/projects/3fdf385012a7472099d32e26839f471e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.765532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdf385012a7472099d32e26839f471e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.767541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.774858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2de8b0-8104-42bc-807e-6e3ead545f58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.776477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2de8b0-8104-42bc-807e-6e3ead545f58 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.785785 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1065/2140] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:34:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 14:34:44.825470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdf385012a7472099d32e26839f471e', 'request_id': 'req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.835412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdf385012a7472099d32e26839f471e', 'request_id': 'req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.847392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdf385012a7472099d32e26839f471e', 'request_id': 'req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.862350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] The token cache is being invalidate because project 3fdf385012a7472099d32e26839f471e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:44.863222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.863968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0a171aab-e67f-42c5-b7f9-61f745e8a4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:44.866476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1076/2141] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:44 2022] DELETE /identity/v3/projects/3fdf385012a7472099d32e26839f471e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:44.870345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2de8b0-8104-42bc-807e-6e3ead545f58 service swift] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:44.884140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2de8b0-8104-42bc-807e-6e3ead545f58 service swift] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:44.981467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:44.982682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:44.982829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:44.983180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] PATH_INFO: `/v3/users/6c0db96c66774c8e9ae63bc9740c4735` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:44.986968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0db96c66774c8e9ae63bc9740c4735)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.987328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:45.064083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53e37-c7a6-420a-98df-194e49b87a44 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:45.065550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53e37-c7a6-420a-98df-194e49b87a44 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:45.065997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c53e37-c7a6-420a-98df-194e49b87a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:45.101061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-39c53e37-c7a6-420a-98df-194e49b87a44 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:45.102537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-39c53e37-c7a6-420a-98df-194e49b87a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:45.112638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0db96c66774c8e9ae63bc9740c4735'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.114950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0db96c66774c8e9ae63bc9740c4735'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.118364 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:45.130281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0db96c66774c8e9ae63bc9740c4735'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.139876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0db96c66774c8e9ae63bc9740c4735'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.157426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0db96c66774c8e9ae63bc9740c4735'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.168966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1066/2142] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:44 2022] DELETE /identity/v3/users/6c0db96c66774c8e9ae63bc9740c4735 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:45.210915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1077/2143] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:34:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:45.223929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:45.226214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:45.336899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198f01-e43b-40f6-8448-a97ace4bbb7d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:45.346027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf16b05-f069-46fb-a6a8-eb02d7035de9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:45.347450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16b05-f069-46fb-a6a8-eb02d7035de9 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:45.347567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16b05-f069-46fb-a6a8-eb02d7035de9 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:45.347764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16b05-f069-46fb-a6a8-eb02d7035de9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:45.425890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16b05-f069-46fb-a6a8-eb02d7035de9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:45.428549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16b05-f069-46fb-a6a8-eb02d7035de9 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:45.439155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1067/2144] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:34:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:34:45.554646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c53e37-c7a6-420a-98df-194e49b87a44 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:45.556891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-39c53e37-c7a6-420a-98df-194e49b87a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:45.582554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c53e37-c7a6-420a-98df-194e49b87a44 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:45.586957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7e432-c67b-48c4-a351-5cdf6ad32f80 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:45.587258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7e432-c67b-48c4-a351-5cdf6ad32f80 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:45.587601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7e432-c67b-48c4-a351-5cdf6ad32f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:45.604949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:45.621113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-79e7e432-c67b-48c4-a351-5cdf6ad32f80 None None] MFA Rules not processed for user `195821093293441abe4768162a6fe5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:45.622320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-79e7e432-c67b-48c4-a351-5cdf6ad32f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:45.670364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:45.672773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:45.672773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:45.672773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] PATH_INFO: `/v3/projects/1ac304c2bd8d471c9b1c7e87721db943` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:45.674455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac304c2bd8d471c9b1c7e87721db943)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:45.679371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:45.737977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:45.746501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1068/2145] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:45.757247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac304c2bd8d471c9b1c7e87721db943', 'request_id': 'req-a78127e2-9356-42c7-a89e-376deb2f615d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.764109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7e432-c67b-48c4-a351-5cdf6ad32f80 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:45.765577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-79e7e432-c67b-48c4-a351-5cdf6ad32f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:45.765974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac304c2bd8d471c9b1c7e87721db943', 'request_id': 'req-a78127e2-9356-42c7-a89e-376deb2f615d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.776913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac304c2bd8d471c9b1c7e87721db943', 'request_id': 'req-a78127e2-9356-42c7-a89e-376deb2f615d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.805454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] The token cache is being invalidate because project 1ac304c2bd8d471c9b1c7e87721db943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:45.806121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.807116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a78127e2-9356-42c7-a89e-376deb2f615d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:45.810265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1078/2146] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:45 2022] DELETE /identity/v3/projects/1ac304c2bd8d471c9b1c7e87721db943 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:45.815590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b10f-b3b6-456d-87de-54ef4a0619a0 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:45.816150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b10f-b3b6-456d-87de-54ef4a0619a0 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:45.816718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b10f-b3b6-456d-87de-54ef4a0619a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:45.850506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7e432-c67b-48c4-a351-5cdf6ad32f80 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:45.869773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d8f9b10f-b3b6-456d-87de-54ef4a0619a0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:45.871623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d8f9b10f-b3b6-456d-87de-54ef4a0619a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:45.936600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd57ef-e7d0-4eb2-b8b1-e68a8ade4cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:45.937408 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd57ef-e7d0-4eb2-b8b1-e68a8ade4cae service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:45.937711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd57ef-e7d0-4eb2-b8b1-e68a8ade4cae service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:45.937998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd57ef-e7d0-4eb2-b8b1-e68a8ade4cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:45.940813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9cbd57ef-e7d0-4eb2-b8b1-e68a8ade4cae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:46.019240 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1079/2147] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:46.025145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9528737-cbf3-49b0-91fa-a97ba56e2f75 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.025443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9528737-cbf3-49b0-91fa-a97ba56e2f75 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.025730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9528737-cbf3-49b0-91fa-a97ba56e2f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.027748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd57ef-e7d0-4eb2-b8b1-e68a8ade4cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.029217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd57ef-e7d0-4eb2-b8b1-e68a8ade4cae service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.039822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1069/2148] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:46.041153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413232e-fbed-4ce6-b203-34256bc8483f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.041494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413232e-fbed-4ce6-b203-34256bc8483f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.041781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413232e-fbed-4ce6-b203-34256bc8483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.062995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7413232e-fbed-4ce6-b203-34256bc8483f None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:46.064242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7413232e-fbed-4ce6-b203-34256bc8483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:46.067893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f9528737-cbf3-49b0-91fa-a97ba56e2f75 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:46.069170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f9528737-cbf3-49b0-91fa-a97ba56e2f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:46.077618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1080/2149] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:46.084208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9528737-cbf3-49b0-91fa-a97ba56e2f75 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.097657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9528737-cbf3-49b0-91fa-a97ba56e2f75 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.103814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.104779 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.105213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.105657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.106547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:46.107024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.110036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.135441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1081/2150] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:46.139438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.149432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619f92-aac0-4c89-a3eb-b0c2c3b2d45e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.152658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1070/2151] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jul 12 14:34:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:46.154562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598dba-2d75-45b1-ace8-7f1a57b8c714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.155159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598dba-2d75-45b1-ace8-7f1a57b8c714 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.155449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598dba-2d75-45b1-ace8-7f1a57b8c714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.156258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598dba-2d75-45b1-ace8-7f1a57b8c714 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.156976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598dba-2d75-45b1-ace8-7f1a57b8c714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.159521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598dba-2d75-45b1-ace8-7f1a57b8c714 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.166311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413232e-fbed-4ce6-b203-34256bc8483f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.167793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7413232e-fbed-4ce6-b203-34256bc8483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:46.182797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:46.197654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1082/2152] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:46 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:46.202030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598dba-2d75-45b1-ace8-7f1a57b8c714 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.217621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:46.258376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413232e-fbed-4ce6-b203-34256bc8483f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.286669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598dba-2d75-45b1-ace8-7f1a57b8c714 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.292462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c961de2-4f2d-44f2-a50e-e7084507248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.293319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c961de2-4f2d-44f2-a50e-e7084507248b admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.293817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c961de2-4f2d-44f2-a50e-e7084507248b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.294058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c961de2-4f2d-44f2-a50e-e7084507248b admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.295035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c961de2-4f2d-44f2-a50e-e7084507248b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.296962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c961de2-4f2d-44f2-a50e-e7084507248b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.325692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1083/2153] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:46 2022] POST /identity/v3/users => generated 282 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:46.331083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c961de2-4f2d-44f2-a50e-e7084507248b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.340416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba732ea-573b-4436-a9f5-aa604f5a149d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.341187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba732ea-573b-4436-a9f5-aa604f5a149d service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.341479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba732ea-573b-4436-a9f5-aa604f5a149d service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.341924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba732ea-573b-4436-a9f5-aa604f5a149d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.362571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c961de2-4f2d-44f2-a50e-e7084507248b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.373224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75505db4-3110-403f-ae27-f737a2cad44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.374458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75505db4-3110-403f-ae27-f737a2cad44f admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.374896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75505db4-3110-403f-ae27-f737a2cad44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.375283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75505db4-3110-403f-ae27-f737a2cad44f admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.376829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75505db4-3110-403f-ae27-f737a2cad44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.379636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75505db4-3110-403f-ae27-f737a2cad44f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.399594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1084/2154] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:46.401901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75505db4-3110-403f-ae27-f737a2cad44f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.424108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75505db4-3110-403f-ae27-f737a2cad44f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.432873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af2a2-c972-4054-88a9-c052394fdb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.434104 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af2a2-c972-4054-88a9-c052394fdb43 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.434399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af2a2-c972-4054-88a9-c052394fdb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.434854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af2a2-c972-4054-88a9-c052394fdb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.435901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af2a2-c972-4054-88a9-c052394fdb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.436339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba732ea-573b-4436-a9f5-aa604f5a149d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.437704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af2a2-c972-4054-88a9-c052394fdb43 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.439756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba732ea-573b-4436-a9f5-aa604f5a149d service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.450383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1085/2155] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:46.451167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1071/2156] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:34:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 14:34:46.455816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af2a2-c972-4054-88a9-c052394fdb43 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.475699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af2a2-c972-4054-88a9-c052394fdb43 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.480627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5befbb3-5812-4714-88bc-a1c8ce0f5951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.481670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befbb3-5812-4714-88bc-a1c8ce0f5951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.481960 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befbb3-5812-4714-88bc-a1c8ce0f5951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.482235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befbb3-5812-4714-88bc-a1c8ce0f5951 admin admin] PATH_INFO: `/v3/projects/78f9a19958bd416e946352ce701846fc/users/15b2c0f6a2b440f3b9420eabc10aadba/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.508376 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5befbb3-5812-4714-88bc-a1c8ce0f5951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f9a19958bd416e946352ce701846fc, user_id=15b2c0f6a2b440f3b9420eabc10aadba, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.513010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5befbb3-5812-4714-88bc-a1c8ce0f5951 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.533423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1086/2157] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:46 2022] PUT /identity/v3/projects/78f9a19958bd416e946352ce701846fc/users/15b2c0f6a2b440f3b9420eabc10aadba/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:46.544933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eae8b-aef1-44ec-af96-a9bbdc5ce860 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.545224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eae8b-aef1-44ec-af96-a9bbdc5ce860 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.545526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eae8b-aef1-44ec-af96-a9bbdc5ce860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.577480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6e3eae8b-aef1-44ec-af96-a9bbdc5ce860 None None] MFA Rules not processed for user `15b2c0f6a2b440f3b9420eabc10aadba`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:46.580706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6e3eae8b-aef1-44ec-af96-a9bbdc5ce860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:46.644341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:46.671379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1072/2158] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:46.676486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5befbb3-5812-4714-88bc-a1c8ce0f5951 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.776514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5befbb3-5812-4714-88bc-a1c8ce0f5951 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.787807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f15257-6810-47b3-95cb-e86ce008c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.787807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15257-6810-47b3-95cb-e86ce008c9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.787807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15257-6810-47b3-95cb-e86ce008c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.787807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15257-6810-47b3-95cb-e86ce008c9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.788366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f15257-6810-47b3-95cb-e86ce008c9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.793956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f15257-6810-47b3-95cb-e86ce008c9e2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.829609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1087/2159] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:46 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:46.833684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3eae8b-aef1-44ec-af96-a9bbdc5ce860 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.846846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3eae8b-aef1-44ec-af96-a9bbdc5ce860 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.906722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336bccc-f2fa-498d-93fb-b60833ce9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.907711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336bccc-f2fa-498d-93fb-b60833ce9445 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.908006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336bccc-f2fa-498d-93fb-b60833ce9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.908537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336bccc-f2fa-498d-93fb-b60833ce9445 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.909392 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336bccc-f2fa-498d-93fb-b60833ce9445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.911354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336bccc-f2fa-498d-93fb-b60833ce9445 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.935198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1073/2160] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:46 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:46.938981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f15257-6810-47b3-95cb-e86ce008c9e2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.949490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f15257-6810-47b3-95cb-e86ce008c9e2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.954691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23659de-2170-4f29-a772-86592befb8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.955459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23659de-2170-4f29-a772-86592befb8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.955822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23659de-2170-4f29-a772-86592befb8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.956226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23659de-2170-4f29-a772-86592befb8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.957056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23659de-2170-4f29-a772-86592befb8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.958682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23659de-2170-4f29-a772-86592befb8d7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.970994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1088/2161] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:46.975317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336bccc-f2fa-498d-93fb-b60833ce9445 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.992484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336bccc-f2fa-498d-93fb-b60833ce9445 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.992484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed2e68-8fbb-4780-b550-53525ce34dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.992484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2e68-8fbb-4780-b550-53525ce34dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.992484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2e68-8fbb-4780-b550-53525ce34dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.992826 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2e68-8fbb-4780-b550-53525ce34dad admin admin] PATH_INFO: `/v3/projects/04c13284335a4b1abd129a40f3fb24f2/users/38312cc452c642aa85d4cde329d2a9c7/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:47.009310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed2e68-8fbb-4780-b550-53525ce34dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c13284335a4b1abd129a40f3fb24f2, user_id=38312cc452c642aa85d4cde329d2a9c7, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:47.012158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed2e68-8fbb-4780-b550-53525ce34dad admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:47.028546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1074/2162] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:46 2022] PUT /identity/v3/projects/04c13284335a4b1abd129a40f3fb24f2/users/38312cc452c642aa85d4cde329d2a9c7/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:47.033250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23659de-2170-4f29-a772-86592befb8d7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:47.048304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23659de-2170-4f29-a772-86592befb8d7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:47.095930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:47.132548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b0822-abb2-4b36-9424-ddaa450016e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:47.134134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b0822-abb2-4b36-9424-ddaa450016e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:47.134496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b0822-abb2-4b36-9424-ddaa450016e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:47.134886 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b0822-abb2-4b36-9424-ddaa450016e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:47.135694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b0822-abb2-4b36-9424-ddaa450016e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:47.138025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b0822-abb2-4b36-9424-ddaa450016e7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:47.152877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1089/2163] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:47.154225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed2e68-8fbb-4780-b550-53525ce34dad admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:47.171138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed2e68-8fbb-4780-b550-53525ce34dad admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:47.174311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:47.175477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:47.175703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:47.176027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] PATH_INFO: `/v3/projects/04c13284335a4b1abd129a40f3fb24f2/users/38312cc452c642aa85d4cde329d2a9c7/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:47.178452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c13284335a4b1abd129a40f3fb24f2, user_id=38312cc452c642aa85d4cde329d2a9c7, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:47.181860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:47.193846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1075/2164] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:47 2022] PUT /identity/v3/projects/04c13284335a4b1abd129a40f3fb24f2/users/38312cc452c642aa85d4cde329d2a9c7/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:47.205324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e6ee-7db1-4327-9362-e09dc6c17fd6 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:47.205622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e6ee-7db1-4327-9362-e09dc6c17fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:47.205905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e6ee-7db1-4327-9362-e09dc6c17fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:47.233170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-0276e6ee-7db1-4327-9362-e09dc6c17fd6 None None] MFA Rules not processed for user `38312cc452c642aa85d4cde329d2a9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:47.234613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0276e6ee-7db1-4327-9362-e09dc6c17fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:47.319518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1090/2165] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:47.334401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:47.334401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:47.398974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833963d-818f-4069-9c6e-b0fa50ba7e61 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:47.405413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8abd67-e222-4c73-951c-0e01357be3d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:47.406601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8abd67-e222-4c73-951c-0e01357be3d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:47.407179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8abd67-e222-4c73-951c-0e01357be3d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:47.407713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8abd67-e222-4c73-951c-0e01357be3d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:47.419937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8abd67-e222-4c73-951c-0e01357be3d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:47.421424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8abd67-e222-4c73-951c-0e01357be3d1 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:47.432450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1076/2166] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:47.521656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e6ee-7db1-4327-9362-e09dc6c17fd6 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:47.523212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0276e6ee-7db1-4327-9362-e09dc6c17fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:47.536466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e6ee-7db1-4327-9362-e09dc6c17fd6 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:47.540597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:47.541327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:47.541705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:47.542112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:47.553683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90b73-4ba0-4916-8e74-f43e5c83b065 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:47.554555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90b73-4ba0-4916-8e74-f43e5c83b065 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:47.554946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90b73-4ba0-4916-8e74-f43e5c83b065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:47.580282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-81b90b73-4ba0-4916-8e74-f43e5c83b065 None None] MFA Rules not processed for user `195821093293441abe4768162a6fe5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:47.581693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-81b90b73-4ba0-4916-8e74-f43e5c83b065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:47.608332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:47.609795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:47.619217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1091/2167] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:47.631725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:47.655059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1077/2168] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:48.686134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:48.687627 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:48.737789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:48.754502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db66934-eb8d-462e-b999-893713826733 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:48.759017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:48.759896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:48.760180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:48.760455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] PATH_INFO: `/v3/users/4b9dd3284c3c4868bda7151e608a02f2` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:48.761669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9dd3284c3c4868bda7151e608a02f2)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:48.763625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:48.809805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9dd3284c3c4868bda7151e608a02f2'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:48.823454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9dd3284c3c4868bda7151e608a02f2'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:48.824211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9dd3284c3c4868bda7151e608a02f2'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:48.836405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9dd3284c3c4868bda7151e608a02f2'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:48.845676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9dd3284c3c4868bda7151e608a02f2'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:48.851939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1092/2169] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:48 2022] DELETE /identity/v3/users/4b9dd3284c3c4868bda7151e608a02f2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:48.856726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e61c-b17e-42e6-996f-ac7777fb7644 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:48.857234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e61c-b17e-42e6-996f-ac7777fb7644 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:48.857325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e61c-b17e-42e6-996f-ac7777fb7644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:48.885978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-37e7e61c-b17e-42e6-996f-ac7777fb7644 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:48.887244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-37e7e61c-b17e-42e6-996f-ac7777fb7644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:48.953242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1078/2170] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:48.962852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:48.964282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:49.031768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9a6aa-8bc0-485b-8186-06910c709055 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.035727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adb453-ee69-4e50-9eac-e2eab6ba6f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.036385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb453-ee69-4e50-9eac-e2eab6ba6f35 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.036674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb453-ee69-4e50-9eac-e2eab6ba6f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.036955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb453-ee69-4e50-9eac-e2eab6ba6f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.053059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adb453-ee69-4e50-9eac-e2eab6ba6f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.055018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adb453-ee69-4e50-9eac-e2eab6ba6f35 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.069258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1093/2171] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:49.279922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e61c-b17e-42e6-996f-ac7777fb7644 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:49.281341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-37e7e61c-b17e-42e6-996f-ac7777fb7644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:49.293725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e61c-b17e-42e6-996f-ac7777fb7644 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.298948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.299823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.300110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.300389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] PATH_INFO: `/v3/projects/a6769dcf93a14a338b8e90ef2ee4f6f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.301585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6769dcf93a14a338b8e90ef2ee4f6f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.303537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.350909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6769dcf93a14a338b8e90ef2ee4f6f5', 'request_id': 'req-221dc5cb-0a70-4992-b2a2-769953e97d31'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:49.358105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6769dcf93a14a338b8e90ef2ee4f6f5', 'request_id': 'req-221dc5cb-0a70-4992-b2a2-769953e97d31'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:49.365859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6769dcf93a14a338b8e90ef2ee4f6f5', 'request_id': 'req-221dc5cb-0a70-4992-b2a2-769953e97d31'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:49.387854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] The token cache is being invalidate because project a6769dcf93a14a338b8e90ef2ee4f6f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:49.388149 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:49.388815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-221dc5cb-0a70-4992-b2a2-769953e97d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:49.393718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1079/2172] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:49 2022] DELETE /identity/v3/projects/a6769dcf93a14a338b8e90ef2ee4f6f5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:49.396564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd0b78-321f-4810-867d-8058737ea384 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.396564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd0b78-321f-4810-867d-8058737ea384 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.397136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd0b78-321f-4810-867d-8058737ea384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.445484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4edd0b78-321f-4810-867d-8058737ea384 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:49.447324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4edd0b78-321f-4810-867d-8058737ea384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:49.540757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1094/2173] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:49.548698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a7a4-281c-47db-88e5-80aadd6dc4fd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.548996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a7a4-281c-47db-88e5-80aadd6dc4fd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.549287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a7a4-281c-47db-88e5-80aadd6dc4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.568571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3bf1a7a4-281c-47db-88e5-80aadd6dc4fd None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:49.570489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3bf1a7a4-281c-47db-88e5-80aadd6dc4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:49.581373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1080/2174] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:49.585819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd0b78-321f-4810-867d-8058737ea384 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:49.600128 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd0b78-321f-4810-867d-8058737ea384 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.605847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.606629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.607168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.607460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.608282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:49.608641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.610715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.627528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:49.642209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1095/2175] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:49.642364 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1a7a4-281c-47db-88e5-80aadd6dc4fd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:49.657042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1a7a4-281c-47db-88e5-80aadd6dc4fd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.663978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d1b01-a208-432d-916d-6a954fa3a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.664797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d1b01-a208-432d-916d-6a954fa3a448 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.665710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d1b01-a208-432d-916d-6a954fa3a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.666512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d1b01-a208-432d-916d-6a954fa3a448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.666862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d1b01-a208-432d-916d-6a954fa3a448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.669419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d1b01-a208-432d-916d-6a954fa3a448 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.706822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1081/2176] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:49 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:49.709647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:49.721010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc98d6-07fe-41d1-bb9b-5fd7c14c82c3 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.796711 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535699-2bbb-4ee7-8653-79392d1547a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.797548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535699-2bbb-4ee7-8653-79392d1547a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.797894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535699-2bbb-4ee7-8653-79392d1547a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.798190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535699-2bbb-4ee7-8653-79392d1547a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.798915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7535699-2bbb-4ee7-8653-79392d1547a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.800953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7535699-2bbb-4ee7-8653-79392d1547a3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.821411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1096/2177] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:49 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:49.825699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d1b01-a208-432d-916d-6a954fa3a448 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:49.836801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d1b01-a208-432d-916d-6a954fa3a448 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.841642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4627eb-f5c6-4e90-8c2d-083a08a10c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.842312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4627eb-f5c6-4e90-8c2d-083a08a10c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.842602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4627eb-f5c6-4e90-8c2d-083a08a10c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.842979 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4627eb-f5c6-4e90-8c2d-083a08a10c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.843796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4627eb-f5c6-4e90-8c2d-083a08a10c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.845425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4627eb-f5c6-4e90-8c2d-083a08a10c26 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.855775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1082/2178] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:49.859686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535699-2bbb-4ee7-8653-79392d1547a3 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:49.870210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535699-2bbb-4ee7-8653-79392d1547a3 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.875938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ad07c-873b-4fec-a728-f8ec16e81fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.876609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad07c-873b-4fec-a728-f8ec16e81fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.877031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad07c-873b-4fec-a728-f8ec16e81fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.877319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad07c-873b-4fec-a728-f8ec16e81fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.878051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ad07c-873b-4fec-a728-f8ec16e81fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.879712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ad07c-873b-4fec-a728-f8ec16e81fbc admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.889868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1097/2179] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:49.894517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4627eb-f5c6-4e90-8c2d-083a08a10c26 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:49.905166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4627eb-f5c6-4e90-8c2d-083a08a10c26 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.910268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.911309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.911597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.911946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] PATH_INFO: `/v3/projects/8ab14e1312c54c39831acbf8e81f7c9d/users/85692da8d1774e23b71607618fa8dce3/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.931318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab14e1312c54c39831acbf8e81f7c9d, user_id=85692da8d1774e23b71607618fa8dce3, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.934086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.949067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1083/2180] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:49 2022] PUT /identity/v3/projects/8ab14e1312c54c39831acbf8e81f7c9d/users/85692da8d1774e23b71607618fa8dce3/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:49.959933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477674f-a0be-47aa-9d5f-c451ed711f69 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.960226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477674f-a0be-47aa-9d5f-c451ed711f69 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.960504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477674f-a0be-47aa-9d5f-c451ed711f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.987418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a477674f-a0be-47aa-9d5f-c451ed711f69 None None] MFA Rules not processed for user `85692da8d1774e23b71607618fa8dce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:49.988641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a477674f-a0be-47aa-9d5f-c451ed711f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:50.053063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1098/2181] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:50.064029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:50.065707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:50.076030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:50.126507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0b91-ef2e-4617-b82d-9fe09abd8736 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:50.130941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c667c-cdc3-4029-b223-e59a045b1f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:50.131630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c667c-cdc3-4029-b223-e59a045b1f36 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:50.131918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c667c-cdc3-4029-b223-e59a045b1f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:50.132198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c667c-cdc3-4029-b223-e59a045b1f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:50.140692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c667c-cdc3-4029-b223-e59a045b1f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:50.142145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c667c-cdc3-4029-b223-e59a045b1f36 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:50.151846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1084/2182] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:52.154483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477674f-a0be-47aa-9d5f-c451ed711f69 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:52.157101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a477674f-a0be-47aa-9d5f-c451ed711f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:52.251475 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477674f-a0be-47aa-9d5f-c451ed711f69 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:52.257180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:52.258182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:52.258505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:52.259000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] PATH_INFO: `/v3/users/d384ce3e9f224a3abc30e6f5d6a03021` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:52.267695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d384ce3e9f224a3abc30e6f5d6a03021)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:52.269887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:52.277726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:52.336764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd384ce3e9f224a3abc30e6f5d6a03021'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:52.355212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd384ce3e9f224a3abc30e6f5d6a03021'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:52.357795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd384ce3e9f224a3abc30e6f5d6a03021'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:52.370470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd384ce3e9f224a3abc30e6f5d6a03021'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:52.380478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd384ce3e9f224a3abc30e6f5d6a03021'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:52.388620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1099/2183] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:52 2022] DELETE /identity/v3/users/d384ce3e9f224a3abc30e6f5d6a03021 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:52.915443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c667c-cdc3-4029-b223-e59a045b1f36 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:52.928317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c667c-cdc3-4029-b223-e59a045b1f36 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:53.042070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:53.043065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:53.043565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:53.043997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] PATH_INFO: `/v3/projects/569bc7b94531485ba71fdf204ea610f4` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:53.050810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569bc7b94531485ba71fdf204ea610f4)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:53.052976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:53.122811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569bc7b94531485ba71fdf204ea610f4', 'request_id': 'req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.132707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569bc7b94531485ba71fdf204ea610f4', 'request_id': 'req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.143995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569bc7b94531485ba71fdf204ea610f4', 'request_id': 'req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.165627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] The token cache is being invalidate because project 569bc7b94531485ba71fdf204ea610f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:53.165843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.166573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.168269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1085/2184] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:52 2022] DELETE /identity/v3/projects/569bc7b94531485ba71fdf204ea610f4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:53.174215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:53.176803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:53.197857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa966f-730e-4919-9776-13ef0f2f403c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:53.283349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:53.285191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:53.285752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:53.286046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] PATH_INFO: `/v3/users/62e5832db1774c88bbd83238fb216a11` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:53.287481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e5832db1774c88bbd83238fb216a11)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:53.289574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:53.361791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e5832db1774c88bbd83238fb216a11'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.380741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e5832db1774c88bbd83238fb216a11'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.381482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e5832db1774c88bbd83238fb216a11'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.392629 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e5832db1774c88bbd83238fb216a11'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.403013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ac92fb3d-0ee4-4afe-abb0-761b53006bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e5832db1774c88bbd83238fb216a11'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.410142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1100/2185] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:53 2022] DELETE /identity/v3/users/62e5832db1774c88bbd83238fb216a11 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:53.600686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:53.602347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:53.616162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe8f8-e09d-4c3e-96cf-f84b1772a0f0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:53.679395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:53.703489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:53.704509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:53.704840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:53.705144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] PATH_INFO: `/v3/projects/99a9df3c7a794a23ba28e9fcc901d74d` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:53.706376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a9df3c7a794a23ba28e9fcc901d74d)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:53.708443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:53.766829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a9df3c7a794a23ba28e9fcc901d74d', 'request_id': 'req-18c49cda-7877-441d-8aba-cf135a2d3d70'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.774385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a9df3c7a794a23ba28e9fcc901d74d', 'request_id': 'req-18c49cda-7877-441d-8aba-cf135a2d3d70'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.781392 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a9df3c7a794a23ba28e9fcc901d74d', 'request_id': 'req-18c49cda-7877-441d-8aba-cf135a2d3d70'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.797248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] The token cache is being invalidate because project 99a9df3c7a794a23ba28e9fcc901d74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:53.797564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.798503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-18c49cda-7877-441d-8aba-cf135a2d3d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:53.800540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1086/2186] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:53 2022] DELETE /identity/v3/projects/99a9df3c7a794a23ba28e9fcc901d74d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:53.805269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36d4e-c471-4c80-941f-6eb18ecffd5a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:53.805760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36d4e-c471-4c80-941f-6eb18ecffd5a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:53.806098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36d4e-c471-4c80-941f-6eb18ecffd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:53.816160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:53.833324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4fa36d4e-c471-4c80-941f-6eb18ecffd5a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:53.835877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4fa36d4e-c471-4c80-941f-6eb18ecffd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:53.914999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1101/2187] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:53.923464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156349ca-43db-4a1a-b66b-cea12185e92b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:53.923920 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156349ca-43db-4a1a-b66b-cea12185e92b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:53.924196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156349ca-43db-4a1a-b66b-cea12185e92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:53.949054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-156349ca-43db-4a1a-b66b-cea12185e92b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:53.950411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-156349ca-43db-4a1a-b66b-cea12185e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:53.959008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1087/2188] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:53.963693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa36d4e-c471-4c80-941f-6eb18ecffd5a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:53.976684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa36d4e-c471-4c80-941f-6eb18ecffd5a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:53.981231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:53.981898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:53.982186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:53.982489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:53.983314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:53.983648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:53.985336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:53.998964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1102/2189] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:54.003093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156349ca-43db-4a1a-b66b-cea12185e92b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.015787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156349ca-43db-4a1a-b66b-cea12185e92b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.020847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e1cfa-5671-40b7-8a02-f1d8f55ca0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.021647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1cfa-5671-40b7-8a02-f1d8f55ca0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.022185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1cfa-5671-40b7-8a02-f1d8f55ca0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.022671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1cfa-5671-40b7-8a02-f1d8f55ca0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.024056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e1cfa-5671-40b7-8a02-f1d8f55ca0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:54.026396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e1cfa-5671-40b7-8a02-f1d8f55ca0e6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:54.068927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1088/2190] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:54 2022] POST /identity/v3/projects => generated 359 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:54.074105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.085460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358db8a8-223e-48a1-95ba-e72b6336bfa2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.185308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f40d-abba-4e84-b4be-41355dc26cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.185967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f40d-abba-4e84-b4be-41355dc26cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.186479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f40d-abba-4e84-b4be-41355dc26cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.187492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f40d-abba-4e84-b4be-41355dc26cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.189037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8f40d-abba-4e84-b4be-41355dc26cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:54.192273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8f40d-abba-4e84-b4be-41355dc26cb7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:54.241715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1103/2191] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:54 2022] POST /identity/v3/users => generated 280 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:54.246553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e1cfa-5671-40b7-8a02-f1d8f55ca0e6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.260241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e1cfa-5671-40b7-8a02-f1d8f55ca0e6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.266167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa803fb-4b49-4456-9ed2-2d2026155595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.267066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa803fb-4b49-4456-9ed2-2d2026155595 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.267333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa803fb-4b49-4456-9ed2-2d2026155595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.267674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa803fb-4b49-4456-9ed2-2d2026155595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.268622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa803fb-4b49-4456-9ed2-2d2026155595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:54.270405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa803fb-4b49-4456-9ed2-2d2026155595 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:54.284121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1089/2192] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:54.288457 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f40d-abba-4e84-b4be-41355dc26cb7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.303486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f40d-abba-4e84-b4be-41355dc26cb7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.309105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786ccf9-4c09-45f8-95f9-e76bec87001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.309806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ccf9-4c09-45f8-95f9-e76bec87001d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.310092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ccf9-4c09-45f8-95f9-e76bec87001d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.310367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ccf9-4c09-45f8-95f9-e76bec87001d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.311170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786ccf9-4c09-45f8-95f9-e76bec87001d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:54.313420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786ccf9-4c09-45f8-95f9-e76bec87001d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:54.327201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1104/2193] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:54.330800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa803fb-4b49-4456-9ed2-2d2026155595 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.344824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa803fb-4b49-4456-9ed2-2d2026155595 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.349898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.351082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.351393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.351736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] PATH_INFO: `/v3/projects/521d0e1b5eb94255ba061ddbaa1b3300/users/3aaa7374dee040b3b9359b418347e43c/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.369146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521d0e1b5eb94255ba061ddbaa1b3300, user_id=3aaa7374dee040b3b9359b418347e43c, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:54.371849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:54.389429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1090/2194] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:54 2022] PUT /identity/v3/projects/521d0e1b5eb94255ba061ddbaa1b3300/users/3aaa7374dee040b3b9359b418347e43c/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:54.399783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e1f2-55ac-4755-b484-9e0b055cb5ae None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.400103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e1f2-55ac-4755-b484-9e0b055cb5ae None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.400384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e1f2-55ac-4755-b484-9e0b055cb5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.428638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4386e1f2-55ac-4755-b484-9e0b055cb5ae None None] MFA Rules not processed for user `3aaa7374dee040b3b9359b418347e43c`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:54.429889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4386e1f2-55ac-4755-b484-9e0b055cb5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:54.502536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:54.514230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1105/2195] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:54.549084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.550975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:54.617315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d42eb-84c8-4250-ad10-999a1da0ab37 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.621040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b76abf-bdb1-4836-bba7-8bd0b886bf02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.621730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76abf-bdb1-4836-bba7-8bd0b886bf02 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.622024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76abf-bdb1-4836-bba7-8bd0b886bf02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.622307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76abf-bdb1-4836-bba7-8bd0b886bf02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.632080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b76abf-bdb1-4836-bba7-8bd0b886bf02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:54.633723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b76abf-bdb1-4836-bba7-8bd0b886bf02 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:54.649461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1091/2196] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:54.664306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e1f2-55ac-4755-b484-9e0b055cb5ae None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.735361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e1f2-55ac-4755-b484-9e0b055cb5ae None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.739995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.740879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.741166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.741441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] PATH_INFO: `/v3/users/3aaa7374dee040b3b9359b418347e43c` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.742676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aaa7374dee040b3b9359b418347e43c)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:54.744643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:54.792429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aaa7374dee040b3b9359b418347e43c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:54.804974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aaa7374dee040b3b9359b418347e43c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:54.805660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aaa7374dee040b3b9359b418347e43c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:54.812694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aaa7374dee040b3b9359b418347e43c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:54.819672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aaa7374dee040b3b9359b418347e43c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:54.825693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1106/2197] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:54 2022] DELETE /identity/v3/users/3aaa7374dee040b3b9359b418347e43c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:54.830491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09b85-d949-4ccf-9095-24e07702b8cb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.830823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09b85-d949-4ccf-9095-24e07702b8cb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.831112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09b85-d949-4ccf-9095-24e07702b8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.850540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-76a09b85-d949-4ccf-9095-24e07702b8cb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:54.851800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-76a09b85-d949-4ccf-9095-24e07702b8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:54.855783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:54.915047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1092/2198] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:54.925379 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.927205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:54.993857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fb04f-a7f1-4b30-9f55-0cfe448e87d7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.997560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f543ca-2938-43d8-a3a5-80f317cbc24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.998218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f543ca-2938-43d8-a3a5-80f317cbc24c service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.998507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f543ca-2938-43d8-a3a5-80f317cbc24c service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.998817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f543ca-2938-43d8-a3a5-80f317cbc24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.008483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f543ca-2938-43d8-a3a5-80f317cbc24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:55.014299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f543ca-2938-43d8-a3a5-80f317cbc24c service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:55.024774 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1107/2199] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:55.121000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a09b85-d949-4ccf-9095-24e07702b8cb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:55.122530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-76a09b85-d949-4ccf-9095-24e07702b8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:55.135434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a09b85-d949-4ccf-9095-24e07702b8cb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:55.140275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:55.141160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:55.141451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:55.141734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] PATH_INFO: `/v3/users/15b2c0f6a2b440f3b9420eabc10aadba` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.142996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b2c0f6a2b440f3b9420eabc10aadba)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:55.144929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:55.211878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b2c0f6a2b440f3b9420eabc10aadba'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.212537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b2c0f6a2b440f3b9420eabc10aadba'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.224725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b2c0f6a2b440f3b9420eabc10aadba'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.235797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b2c0f6a2b440f3b9420eabc10aadba'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.250563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b2c0f6a2b440f3b9420eabc10aadba'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.262683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1093/2200] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:55 2022] DELETE /identity/v3/users/15b2c0f6a2b440f3b9420eabc10aadba => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:55.265425 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de03907-bff5-4002-87da-cea1d3f069ba None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:55.269023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de03907-bff5-4002-87da-cea1d3f069ba None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:55.269318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de03907-bff5-4002-87da-cea1d3f069ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.292578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-0de03907-bff5-4002-87da-cea1d3f069ba None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:55.294008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0de03907-bff5-4002-87da-cea1d3f069ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:55.318247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:55.330262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:55.339404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:55.441763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1108/2201] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:55.450951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de03907-bff5-4002-87da-cea1d3f069ba None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:55.453523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0de03907-bff5-4002-87da-cea1d3f069ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:55.463735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeade8e-59b0-49df-aa74-95cee7b59e2f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:55.470885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:55.473881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:55.475128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:55.479577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] PATH_INFO: `/v3/projects/521d0e1b5eb94255ba061ddbaa1b3300` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.481288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=521d0e1b5eb94255ba061ddbaa1b3300)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:55.486235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:55.535150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:55.535290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de03907-bff5-4002-87da-cea1d3f069ba None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:55.541730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaf18c-ea48-4c2c-b3a8-0ed6f0cc7f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:55.542614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf18c-ea48-4c2c-b3a8-0ed6f0cc7f60 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:55.543517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf18c-ea48-4c2c-b3a8-0ed6f0cc7f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:55.543883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf18c-ea48-4c2c-b3a8-0ed6f0cc7f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.559027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaf18c-ea48-4c2c-b3a8-0ed6f0cc7f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:55.560922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaf18c-ea48-4c2c-b3a8-0ed6f0cc7f60 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:55.574592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521d0e1b5eb94255ba061ddbaa1b3300', 'request_id': 'req-36140e66-a96c-447e-8e85-bfd851700b0e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.575292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1109/2202] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:55.591217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521d0e1b5eb94255ba061ddbaa1b3300', 'request_id': 'req-36140e66-a96c-447e-8e85-bfd851700b0e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.598221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521d0e1b5eb94255ba061ddbaa1b3300', 'request_id': 'req-36140e66-a96c-447e-8e85-bfd851700b0e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.617948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] The token cache is being invalidate because project 521d0e1b5eb94255ba061ddbaa1b3300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:55.618763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.619528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-36140e66-a96c-447e-8e85-bfd851700b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:55.621336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1094/2203] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:55 2022] DELETE /identity/v3/projects/521d0e1b5eb94255ba061ddbaa1b3300 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:55.626898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9d4e6-3743-4761-a33a-fb7eac6ac901 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:55.628260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9d4e6-3743-4761-a33a-fb7eac6ac901 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:55.628576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9d4e6-3743-4761-a33a-fb7eac6ac901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.656140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-c2e9d4e6-3743-4761-a33a-fb7eac6ac901 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:55.657734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c2e9d4e6-3743-4761-a33a-fb7eac6ac901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:55.747872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1110/2204] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:55.756231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e71d-8568-419a-bb4f-0d7a4aad1d42 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:55.756658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e71d-8568-419a-bb4f-0d7a4aad1d42 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:55.757154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e71d-8568-419a-bb4f-0d7a4aad1d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.822263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-66a4e71d-8568-419a-bb4f-0d7a4aad1d42 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:55.823888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-66a4e71d-8568-419a-bb4f-0d7a4aad1d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:55.835138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1095/2205] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:55.840060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9d4e6-3743-4761-a33a-fb7eac6ac901 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:55.854317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9d4e6-3743-4761-a33a-fb7eac6ac901 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:55.861980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:55.869913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:55.869913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:55.869913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.869913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:55.869913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:55.869913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:55.889322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1111/2206] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:55.890746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4e71d-8568-419a-bb4f-0d7a4aad1d42 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:55.903000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4e71d-8568-419a-bb4f-0d7a4aad1d42 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:55.913490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70030821-8a73-4dfe-88e4-9e8ae85fad6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:55.914397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70030821-8a73-4dfe-88e4-9e8ae85fad6e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:55.914571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70030821-8a73-4dfe-88e4-9e8ae85fad6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:55.915009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70030821-8a73-4dfe-88e4-9e8ae85fad6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:55.915796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70030821-8a73-4dfe-88e4-9e8ae85fad6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:55.919458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70030821-8a73-4dfe-88e4-9e8ae85fad6e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:55.977180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:55.981032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:55.984583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1096/2207] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:55 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:55.985750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70030821-8a73-4dfe-88e4-9e8ae85fad6e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.022633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f81a-f9d4-45bb-9aee-f67813ad99c8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.072632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70030821-8a73-4dfe-88e4-9e8ae85fad6e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.079104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548202f1-9cd5-4ad4-871d-64e871e3988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.079907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548202f1-9cd5-4ad4-871d-64e871e3988c admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.080302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548202f1-9cd5-4ad4-871d-64e871e3988c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.080752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548202f1-9cd5-4ad4-871d-64e871e3988c admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.081559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548202f1-9cd5-4ad4-871d-64e871e3988c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.083627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548202f1-9cd5-4ad4-871d-64e871e3988c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.108827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:56.123161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.125060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.125647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.126143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] PATH_INFO: `/v3/projects/78f9a19958bd416e946352ce701846fc` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.128460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1097/2208] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:55 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:56.128928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f9a19958bd416e946352ce701846fc)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.131241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.132113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548202f1-9cd5-4ad4-871d-64e871e3988c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.146488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548202f1-9cd5-4ad4-871d-64e871e3988c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.152676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b3ea5-f082-46dd-9f22-8b42c870e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.153355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b3ea5-f082-46dd-9f22-8b42c870e659 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.153831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b3ea5-f082-46dd-9f22-8b42c870e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.154321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b3ea5-f082-46dd-9f22-8b42c870e659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.155315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b3ea5-f082-46dd-9f22-8b42c870e659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.158267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b3ea5-f082-46dd-9f22-8b42c870e659 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.172190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1098/2209] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:56.178000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b3ea5-f082-46dd-9f22-8b42c870e659 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.194037 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b3ea5-f082-46dd-9f22-8b42c870e659 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.196290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f9a19958bd416e946352ce701846fc', 'request_id': 'req-b94b48cb-1197-438b-86ec-4f20bed85f64'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.211719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f9a19958bd416e946352ce701846fc', 'request_id': 'req-b94b48cb-1197-438b-86ec-4f20bed85f64'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.227860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f9a19958bd416e946352ce701846fc', 'request_id': 'req-b94b48cb-1197-438b-86ec-4f20bed85f64'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.245565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] The token cache is being invalidate because project 78f9a19958bd416e946352ce701846fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:56.245871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.246703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.253401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1112/2210] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:55 2022] DELETE /identity/v3/projects/78f9a19958bd416e946352ce701846fc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:56.257132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.258586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:56.267905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.268609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.269066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.269357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.270106 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.271960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.274573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:56.295064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1099/2211] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:56.298334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.303047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:56.347951 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adef7c-b072-41c9-ab09-6bc53d0f4215 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.354765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482966a-8640-4c90-80be-8cf8af3a30ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.355885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482966a-8640-4c90-80be-8cf8af3a30ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.356183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482966a-8640-4c90-80be-8cf8af3a30ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.356464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482966a-8640-4c90-80be-8cf8af3a30ad admin admin] PATH_INFO: `/v3/projects/7da273fd669146ecb4078308af94bcaa/users/7cc050e046784e439ed7117f1d6be42e/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.375537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482966a-8640-4c90-80be-8cf8af3a30ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da273fd669146ecb4078308af94bcaa, user_id=7cc050e046784e439ed7117f1d6be42e, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.378156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482966a-8640-4c90-80be-8cf8af3a30ad admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.385876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b48cb-1197-438b-86ec-4f20bed85f64 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.393865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1100/2212] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:56 2022] PUT /identity/v3/projects/7da273fd669146ecb4078308af94bcaa/users/7cc050e046784e439ed7117f1d6be42e/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:56.404634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1bf4-8169-4cca-a0af-950e2dc4339a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.404927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1bf4-8169-4cca-a0af-950e2dc4339a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.405218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1bf4-8169-4cca-a0af-950e2dc4339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.434247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-685c1bf4-8169-4cca-a0af-950e2dc4339a None None] MFA Rules not processed for user `7cc050e046784e439ed7117f1d6be42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:56.435442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-685c1bf4-8169-4cca-a0af-950e2dc4339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:56.457849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.458876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.459261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.459889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] PATH_INFO: `/v3/users/38312cc452c642aa85d4cde329d2a9c7` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.460960 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] RBAC: Authorizing `identity:delete_user(user_id=38312cc452c642aa85d4cde329d2a9c7)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.462961 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.501129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:56.514843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1101/2213] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:56.516632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1bf4-8169-4cca-a0af-950e2dc4339a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.520273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38312cc452c642aa85d4cde329d2a9c7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.527897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1bf4-8169-4cca-a0af-950e2dc4339a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.533216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506c457-8570-4217-946c-9d101acbb005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.534291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c457-8570-4217-946c-9d101acbb005 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.534586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c457-8570-4217-946c-9d101acbb005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.535233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c457-8570-4217-946c-9d101acbb005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.536089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506c457-8570-4217-946c-9d101acbb005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.536288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38312cc452c642aa85d4cde329d2a9c7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.536936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38312cc452c642aa85d4cde329d2a9c7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.538027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506c457-8570-4217-946c-9d101acbb005 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.546959 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38312cc452c642aa85d4cde329d2a9c7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.555158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38312cc452c642aa85d4cde329d2a9c7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.562523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1113/2214] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:34:56 2022] DELETE /identity/v3/users/38312cc452c642aa85d4cde329d2a9c7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:56.572344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1102/2215] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:56 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:56.573538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.575002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:56.656483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd5712-7544-4d6e-884c-82c339c465db admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.728622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a3a4f-2b0b-4216-b996-c1f3e36d380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.729320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a3a4f-2b0b-4216-b996-c1f3e36d380e admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.729608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a3a4f-2b0b-4216-b996-c1f3e36d380e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.729889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a3a4f-2b0b-4216-b996-c1f3e36d380e admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.730587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a3a4f-2b0b-4216-b996-c1f3e36d380e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.732572 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a3a4f-2b0b-4216-b996-c1f3e36d380e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.765252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1114/2216] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:56 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:56.769092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506c457-8570-4217-946c-9d101acbb005 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.783983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506c457-8570-4217-946c-9d101acbb005 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.793756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdd7ce-b559-462c-975f-c034715b2250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.794826 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdd7ce-b559-462c-975f-c034715b2250 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.795174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdd7ce-b559-462c-975f-c034715b2250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.795351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdd7ce-b559-462c-975f-c034715b2250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.797237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdd7ce-b559-462c-975f-c034715b2250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.802173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdd7ce-b559-462c-975f-c034715b2250 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.818644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1103/2217] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:56.820029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a3a4f-2b0b-4216-b996-c1f3e36d380e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.831544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a3a4f-2b0b-4216-b996-c1f3e36d380e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.836573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.837246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.837533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.837816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.838571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.840220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.851359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1115/2218] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:56.855645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdd7ce-b559-462c-975f-c034715b2250 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.867032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdd7ce-b559-462c-975f-c034715b2250 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.870030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:56.872018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:56.875673 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745c5f-3b7a-4592-9761-53a46cfbaa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.876711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745c5f-3b7a-4592-9761-53a46cfbaa87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.877000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745c5f-3b7a-4592-9761-53a46cfbaa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.877282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745c5f-3b7a-4592-9761-53a46cfbaa87 admin admin] PATH_INFO: `/v3/projects/e9a158a5e92b42ca9fa72f981d544baf/users/665f0ae248ed44519815e1510bced04e/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.887991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c70f9-0866-45d9-a355-66f3483aa878 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:56.893350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:56.893825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07745c5f-3b7a-4592-9761-53a46cfbaa87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a158a5e92b42ca9fa72f981d544baf, user_id=665f0ae248ed44519815e1510bced04e, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.894231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.894520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.894823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] PATH_INFO: `/v3/projects/04c13284335a4b1abd129a40f3fb24f2` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.896573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07745c5f-3b7a-4592-9761-53a46cfbaa87 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.904734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c13284335a4b1abd129a40f3fb24f2)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:56.907070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:56.912075 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1104/2219] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:56 2022] PUT /identity/v3/projects/e9a158a5e92b42ca9fa72f981d544baf/users/665f0ae248ed44519815e1510bced04e/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:56.922852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6cc5-8768-47e6-8054-b4891c63732b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.923131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6cc5-8768-47e6-8054-b4891c63732b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.923471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff6cc5-8768-47e6-8054-b4891c63732b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.946454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:56.953393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9cff6cc5-8768-47e6-8054-b4891c63732b None None] MFA Rules not processed for user `665f0ae248ed44519815e1510bced04e`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:56.954608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9cff6cc5-8768-47e6-8054-b4891c63732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:56.962821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c13284335a4b1abd129a40f3fb24f2', 'request_id': 'req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.971691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c13284335a4b1abd129a40f3fb24f2', 'request_id': 'req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.980097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c13284335a4b1abd129a40f3fb24f2', 'request_id': 'req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.995625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] The token cache is being invalidate because project 04c13284335a4b1abd129a40f3fb24f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:34:56.995930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.996561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-f3615f40-4179-4d6b-bee7-a7f8d8833ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:34:56.998149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1116/2220] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:34:56 2022] DELETE /identity/v3/projects/04c13284335a4b1abd129a40f3fb24f2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:57.003389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c260-96ce-45bd-955c-3b4345ea1282 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.003684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c260-96ce-45bd-955c-3b4345ea1282 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.003966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c260-96ce-45bd-955c-3b4345ea1282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.021219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:57.023532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-de36c260-96ce-45bd-955c-3b4345ea1282 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:57.024818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-de36c260-96ce-45bd-955c-3b4345ea1282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.033138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1105/2221] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:57.037834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff6cc5-8768-47e6-8054-b4891c63732b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.040262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9cff6cc5-8768-47e6-8054-b4891c63732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.112188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1117/2222] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:57.118346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff6cc5-8768-47e6-8054-b4891c63732b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.120213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba770-4676-4f5b-bbd1-89849c154d7a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.120511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba770-4676-4f5b-bbd1-89849c154d7a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.120789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba770-4676-4f5b-bbd1-89849c154d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.123857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8575d62-c5e6-47a1-b604-234c5124dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.124569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575d62-c5e6-47a1-b604-234c5124dc33 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.125129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575d62-c5e6-47a1-b604-234c5124dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.125418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575d62-c5e6-47a1-b604-234c5124dc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.126118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8575d62-c5e6-47a1-b604-234c5124dc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.128179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8575d62-c5e6-47a1-b604-234c5124dc33 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.143744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-201ba770-4676-4f5b-bbd1-89849c154d7a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:57.145098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-201ba770-4676-4f5b-bbd1-89849c154d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.153768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1118/2223] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:57.154607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1106/2224] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:57.159228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba770-4676-4f5b-bbd1-89849c154d7a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.159378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8575d62-c5e6-47a1-b604-234c5124dc33 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.168377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba770-4676-4f5b-bbd1-89849c154d7a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.222069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8575d62-c5e6-47a1-b604-234c5124dc33 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.223594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.224262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.224553 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.224828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.225554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:34:57.225864 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.227755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013216c-ac5d-4a86-9e15-14e723b3de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.228050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.228594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013216c-ac5d-4a86-9e15-14e723b3de65 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.228883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013216c-ac5d-4a86-9e15-14e723b3de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.229171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013216c-ac5d-4a86-9e15-14e723b3de65 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.229908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013216c-ac5d-4a86-9e15-14e723b3de65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.231902 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013216c-ac5d-4a86-9e15-14e723b3de65 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.245771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1119/2225] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:34:57.246266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.253664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1107/2226] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:57.257541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013216c-ac5d-4a86-9e15-14e723b3de65 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.259807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fa5fc-97a4-4423-8d0f-589dec996383 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.264885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138401-350d-4108-8f65-2212e0b3beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.265549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138401-350d-4108-8f65-2212e0b3beb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.265838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138401-350d-4108-8f65-2212e0b3beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.266110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138401-350d-4108-8f65-2212e0b3beb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.266841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b138401-350d-4108-8f65-2212e0b3beb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.268620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013216c-ac5d-4a86-9e15-14e723b3de65 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.268733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b138401-350d-4108-8f65-2212e0b3beb1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.273639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428267-f681-4025-acc3-f7edeb543601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.274362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428267-f681-4025-acc3-f7edeb543601 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.274658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428267-f681-4025-acc3-f7edeb543601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.274967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428267-f681-4025-acc3-f7edeb543601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.275725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428267-f681-4025-acc3-f7edeb543601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.277317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428267-f681-4025-acc3-f7edeb543601 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.289813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1108/2227] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:57.294117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428267-f681-4025-acc3-f7edeb543601 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.304948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1120/2228] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:34:57.307255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428267-f681-4025-acc3-f7edeb543601 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.309547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138401-350d-4108-8f65-2212e0b3beb1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.342558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:57.373220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e49a-aa92-4103-9021-9520d93603dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.376320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e49a-aa92-4103-9021-9520d93603dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.376320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e49a-aa92-4103-9021-9520d93603dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.376538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e49a-aa92-4103-9021-9520d93603dc admin admin] PATH_INFO: `/v3/projects/e1ade463320b4d559e3c96ae8dc24631/users/10e00377f308448a9bfd760504f8c872/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.379161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:57.401610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e49a-aa92-4103-9021-9520d93603dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ade463320b4d559e3c96ae8dc24631, user_id=10e00377f308448a9bfd760504f8c872, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.413576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138401-350d-4108-8f65-2212e0b3beb1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.414533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e49a-aa92-4103-9021-9520d93603dc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.421760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff617ba8-01f2-470b-91be-4dfde65b2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.422651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617ba8-01f2-470b-91be-4dfde65b2df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.422901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617ba8-01f2-470b-91be-4dfde65b2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.423235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617ba8-01f2-470b-91be-4dfde65b2df5 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.423937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff617ba8-01f2-470b-91be-4dfde65b2df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.426095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff617ba8-01f2-470b-91be-4dfde65b2df5 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.431381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1109/2229] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:57 2022] PUT /identity/v3/projects/e1ade463320b4d559e3c96ae8dc24631/users/10e00377f308448a9bfd760504f8c872/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:34:57.435710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e49a-aa92-4103-9021-9520d93603dc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.448984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1121/2230] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/users => generated 283 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:57.453521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff617ba8-01f2-470b-91be-4dfde65b2df5 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.463691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff617ba8-01f2-470b-91be-4dfde65b2df5 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.510362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e49a-aa92-4103-9021-9520d93603dc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.515912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e472d-de03-4eeb-92ac-7067cc5750ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.517405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e472d-de03-4eeb-92ac-7067cc5750ed admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.517405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e472d-de03-4eeb-92ac-7067cc5750ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.517405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e472d-de03-4eeb-92ac-7067cc5750ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.517888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e472d-de03-4eeb-92ac-7067cc5750ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.519559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e472d-de03-4eeb-92ac-7067cc5750ed admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.527985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cc61-6415-458e-92f0-aa70ebed1a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.528584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cc61-6415-458e-92f0-aa70ebed1a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.528870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cc61-6415-458e-92f0-aa70ebed1a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.529147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cc61-6415-458e-92f0-aa70ebed1a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.529869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1110/2231] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:57.533631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9cc61-6415-458e-92f0-aa70ebed1a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.534894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e472d-de03-4eeb-92ac-7067cc5750ed admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.535598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9cc61-6415-458e-92f0-aa70ebed1a3d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.544714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e472d-de03-4eeb-92ac-7067cc5750ed admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.548593 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1122/2232] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:57.549553 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cc61-6415-458e-92f0-aa70ebed1a3d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.552664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18beaa-71a2-4033-979b-2c6428112774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.553587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18beaa-71a2-4033-979b-2c6428112774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.553878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18beaa-71a2-4033-979b-2c6428112774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.554168 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18beaa-71a2-4033-979b-2c6428112774 admin admin] PATH_INFO: `/v3/projects/e1ade463320b4d559e3c96ae8dc24631/users/10e00377f308448a9bfd760504f8c872/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.556208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18beaa-71a2-4033-979b-2c6428112774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ade463320b4d559e3c96ae8dc24631, user_id=10e00377f308448a9bfd760504f8c872, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.558871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cc61-6415-458e-92f0-aa70ebed1a3d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.558987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18beaa-71a2-4033-979b-2c6428112774 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.563630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f70a6-9eb6-4bb9-b389-d42168f57535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.564265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f70a6-9eb6-4bb9-b389-d42168f57535 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.564555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f70a6-9eb6-4bb9-b389-d42168f57535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.564838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f70a6-9eb6-4bb9-b389-d42168f57535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.565529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f70a6-9eb6-4bb9-b389-d42168f57535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.567125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f70a6-9eb6-4bb9-b389-d42168f57535 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.569862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1111/2233] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:57 2022] PUT /identity/v3/projects/e1ade463320b4d559e3c96ae8dc24631/users/10e00377f308448a9bfd760504f8c872/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:57.578792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1123/2234] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:57.580526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506fc4f-7162-4077-b16c-9e868878986e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.580824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506fc4f-7162-4077-b16c-9e868878986e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.581110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506fc4f-7162-4077-b16c-9e868878986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.582527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f70a6-9eb6-4bb9-b389-d42168f57535 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.591946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f70a6-9eb6-4bb9-b389-d42168f57535 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.610137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5506fc4f-7162-4077-b16c-9e868878986e None None] MFA Rules not processed for user `10e00377f308448a9bfd760504f8c872`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:57.611422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5506fc4f-7162-4077-b16c-9e868878986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.652951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67deb51-0bb2-40b9-8989-218b6df52a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.654234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67deb51-0bb2-40b9-8989-218b6df52a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.654521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67deb51-0bb2-40b9-8989-218b6df52a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.654825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67deb51-0bb2-40b9-8989-218b6df52a91 admin admin] PATH_INFO: `/v3/projects/0e0de974dc064172941811cc63d8a1e1/users/5da75610b7b849218fc89f4518bbf4cc/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.670372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67deb51-0bb2-40b9-8989-218b6df52a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0de974dc064172941811cc63d8a1e1, user_id=5da75610b7b849218fc89f4518bbf4cc, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.679428 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67deb51-0bb2-40b9-8989-218b6df52a91 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.688806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1112/2235] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:57.699197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506fc4f-7162-4077-b16c-9e868878986e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.700801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5506fc4f-7162-4077-b16c-9e868878986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.703856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1124/2236] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:57 2022] PUT /identity/v3/projects/0e0de974dc064172941811cc63d8a1e1/users/5da75610b7b849218fc89f4518bbf4cc/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:57.713897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152c13e-077d-467c-b6ed-fdd02e44536a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.714189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152c13e-077d-467c-b6ed-fdd02e44536a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.714470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152c13e-077d-467c-b6ed-fdd02e44536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.742836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b152c13e-077d-467c-b6ed-fdd02e44536a None None] MFA Rules not processed for user `5da75610b7b849218fc89f4518bbf4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:57.744217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b152c13e-077d-467c-b6ed-fdd02e44536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.754441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:57.765700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506fc4f-7162-4077-b16c-9e868878986e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.769263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:57.815010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1125/2237] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:57.816576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.817240 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.817548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.817813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.819524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152c13e-077d-467c-b6ed-fdd02e44536a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.819651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.879080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.880518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.881211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152c13e-077d-467c-b6ed-fdd02e44536a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.885915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1527e-41c7-415e-aa0b-7eab45074571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.886580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1527e-41c7-415e-aa0b-7eab45074571 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.886898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1527e-41c7-415e-aa0b-7eab45074571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.887311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1527e-41c7-415e-aa0b-7eab45074571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.888006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1527e-41c7-415e-aa0b-7eab45074571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.889295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1113/2238] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:57.890484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1527e-41c7-415e-aa0b-7eab45074571 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.916752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1126/2239] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:57.920950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.932789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7629590-d7ff-41eb-b3b2-98f474d90ef2 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.992433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2109933-75bc-461e-88f0-56047945bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.993165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2109933-75bc-461e-88f0-56047945bed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.993450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2109933-75bc-461e-88f0-56047945bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.993894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2109933-75bc-461e-88f0-56047945bed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.994594 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2109933-75bc-461e-88f0-56047945bed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.996571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2109933-75bc-461e-88f0-56047945bed5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:58.019151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1114/2240] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:34:57 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:34:58.023249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1527e-41c7-415e-aa0b-7eab45074571 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:58.034581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1527e-41c7-415e-aa0b-7eab45074571 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:58.040468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f1f34-c766-4102-8b89-593fd114f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:58.041227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f1f34-c766-4102-8b89-593fd114f9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:58.041523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f1f34-c766-4102-8b89-593fd114f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:58.041805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f1f34-c766-4102-8b89-593fd114f9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:58.042535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f1f34-c766-4102-8b89-593fd114f9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:58.050098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f1f34-c766-4102-8b89-593fd114f9a7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:58.061513 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1127/2241] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:34:58.068023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2109933-75bc-461e-88f0-56047945bed5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:58.078739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2109933-75bc-461e-88f0-56047945bed5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:58.083781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af96883-8b31-42d0-bf12-cdb7cdb14236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:58.084670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af96883-8b31-42d0-bf12-cdb7cdb14236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:58.084955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af96883-8b31-42d0-bf12-cdb7cdb14236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:58.085229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af96883-8b31-42d0-bf12-cdb7cdb14236 admin admin] PATH_INFO: `/v3/projects/c2923eac011d4481aad48446af588447/users/8d65cf303472458bb444da3ba99cd225/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:58.100494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af96883-8b31-42d0-bf12-cdb7cdb14236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2923eac011d4481aad48446af588447, user_id=8d65cf303472458bb444da3ba99cd225, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:58.103205 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af96883-8b31-42d0-bf12-cdb7cdb14236 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:58.116162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1115/2242] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:58 2022] PUT /identity/v3/projects/c2923eac011d4481aad48446af588447/users/8d65cf303472458bb444da3ba99cd225/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:58.120913 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f1f34-c766-4102-8b89-593fd114f9a7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:58.131838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f1f34-c766-4102-8b89-593fd114f9a7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:58.209110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01eaa34-18d3-4995-aef7-d0d32bc887e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:58.212997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eaa34-18d3-4995-aef7-d0d32bc887e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:58.212997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eaa34-18d3-4995-aef7-d0d32bc887e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:58.212997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eaa34-18d3-4995-aef7-d0d32bc887e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:58.212997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01eaa34-18d3-4995-aef7-d0d32bc887e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:58.213514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01eaa34-18d3-4995-aef7-d0d32bc887e7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:58.225803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1128/2243] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:34:58.230182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af96883-8b31-42d0-bf12-cdb7cdb14236 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:58.241628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af96883-8b31-42d0-bf12-cdb7cdb14236 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:58.246922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828031a-f352-4074-b2c5-d249fdf5f4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:58.247934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828031a-f352-4074-b2c5-d249fdf5f4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:58.248304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828031a-f352-4074-b2c5-d249fdf5f4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:58.248618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828031a-f352-4074-b2c5-d249fdf5f4c3 admin admin] PATH_INFO: `/v3/projects/c2923eac011d4481aad48446af588447/users/8d65cf303472458bb444da3ba99cd225/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:58.251241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828031a-f352-4074-b2c5-d249fdf5f4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2923eac011d4481aad48446af588447, user_id=8d65cf303472458bb444da3ba99cd225, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:58.253939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828031a-f352-4074-b2c5-d249fdf5f4c3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:58.276405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1116/2244] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:34:58 2022] PUT /identity/v3/projects/c2923eac011d4481aad48446af588447/users/8d65cf303472458bb444da3ba99cd225/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:34:58.285613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd77e-31d8-4b77-890a-21ab7692b00a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:58.285910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd77e-31d8-4b77-890a-21ab7692b00a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:58.286194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd77e-31d8-4b77-890a-21ab7692b00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:58.316823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-16edd77e-31d8-4b77-890a-21ab7692b00a None None] MFA Rules not processed for user `8d65cf303472458bb444da3ba99cd225`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:58.318000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-16edd77e-31d8-4b77-890a-21ab7692b00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:58.329881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:58.393263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1129/2245] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:34:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:58.404756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828031a-f352-4074-b2c5-d249fdf5f4c3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:58.432624 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:58.507091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828031a-f352-4074-b2c5-d249fdf5f4c3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:58.510888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:58.511783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:58.512575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:58.512575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:58.532663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:58.534442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:58.545297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1117/2246] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:58.625664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd77e-31d8-4b77-890a-21ab7692b00a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:58.635483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd77e-31d8-4b77-890a-21ab7692b00a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:58.639014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b052f7-ad8d-43c4-85d6-07542a43bedc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:58.639691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b052f7-ad8d-43c4-85d6-07542a43bedc service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:58.639981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b052f7-ad8d-43c4-85d6-07542a43bedc service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:58.640431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b052f7-ad8d-43c4-85d6-07542a43bedc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:58.697477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b052f7-ad8d-43c4-85d6-07542a43bedc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:58.699069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b052f7-ad8d-43c4-85d6-07542a43bedc service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:58.709014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1130/2247] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:59.397787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:59.399281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:59.411354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112ae9a-01eb-4b6b-98b9-f454564d7628 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:59.415310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:59.416100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:59.416465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:59.416835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:59.487757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:59.489467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:59.501827 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1118/2248] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:00.097146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b052f7-ad8d-43c4-85d6-07542a43bedc service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:00.106174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b052f7-ad8d-43c4-85d6-07542a43bedc service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:00.110622 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e0852-ec76-4f2d-a44f-af91c69bd55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:00.111232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e0852-ec76-4f2d-a44f-af91c69bd55a service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:00.111505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e0852-ec76-4f2d-a44f-af91c69bd55a service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:00.111792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e0852-ec76-4f2d-a44f-af91c69bd55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:00.173507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e0852-ec76-4f2d-a44f-af91c69bd55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:00.175024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e0852-ec76-4f2d-a44f-af91c69bd55a service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:00.184644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1131/2249] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:00.787294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:00.788723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:00.860964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e841c30-e854-4489-90df-237393b6fd51 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:00.865441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:00.866325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:00.866614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:00.866950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] PATH_INFO: `/v3/users/85692da8d1774e23b71607618fa8dce3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:00.868260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85692da8d1774e23b71607618fa8dce3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:00.870202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:00.924382 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85692da8d1774e23b71607618fa8dce3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:00.925177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85692da8d1774e23b71607618fa8dce3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:00.934158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85692da8d1774e23b71607618fa8dce3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:00.937232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:00.943900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85692da8d1774e23b71607618fa8dce3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:00.958300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85692da8d1774e23b71607618fa8dce3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:00.964571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1119/2250] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:00 2022] DELETE /identity/v3/users/85692da8d1774e23b71607618fa8dce3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:00.969187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d21d-787c-4486-beb0-223f8e4dc651 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:00.969489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d21d-787c-4486-beb0-223f8e4dc651 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:00.969800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d21d-787c-4486-beb0-223f8e4dc651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:00.987001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5f82d21d-787c-4486-beb0-223f8e4dc651 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:00.988197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5f82d21d-787c-4486-beb0-223f8e4dc651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:01.021357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:01.046613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1132/2251] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:01.056225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:01.057653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:01.114814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee034bbb-5cae-46a7-afa0-e8ba2f9f57b4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:01.118374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:01.119065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:01.119354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:01.119637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:01.128995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:01.130418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:01.140269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1120/2252] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:01.435423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82d21d-787c-4486-beb0-223f8e4dc651 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:01.438365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5f82d21d-787c-4486-beb0-223f8e4dc651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:01.458722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:01.460550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:01.477068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82d21d-787c-4486-beb0-223f8e4dc651 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:01.477748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917524-1a42-41fa-b065-d6df6217b627 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:01.482500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:01.482682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:01.484229 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:01.484381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:01.484622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:01.484732 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:01.484981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] PATH_INFO: `/v3/projects/8ab14e1312c54c39831acbf8e81f7c9d` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:01.485126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] PATH_INFO: `/v3/users/5da75610b7b849218fc89f4518bbf4cc` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:01.486492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da75610b7b849218fc89f4518bbf4cc)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:01.486617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab14e1312c54c39831acbf8e81f7c9d)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:01.488435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:01.488640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:01.543387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da75610b7b849218fc89f4518bbf4cc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.544103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da75610b7b849218fc89f4518bbf4cc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.551534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab14e1312c54c39831acbf8e81f7c9d', 'request_id': 'req-9f5583db-3a42-4d3e-9eae-48baca64cbbc'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.554609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da75610b7b849218fc89f4518bbf4cc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.558408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab14e1312c54c39831acbf8e81f7c9d', 'request_id': 'req-9f5583db-3a42-4d3e-9eae-48baca64cbbc'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.564262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da75610b7b849218fc89f4518bbf4cc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.565642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab14e1312c54c39831acbf8e81f7c9d', 'request_id': 'req-9f5583db-3a42-4d3e-9eae-48baca64cbbc'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.583674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da75610b7b849218fc89f4518bbf4cc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.586563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] The token cache is being invalidate because project 8ab14e1312c54c39831acbf8e81f7c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:01.586563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.587083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-9f5583db-3a42-4d3e-9eae-48baca64cbbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:01.588956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1133/2253] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:01 2022] DELETE /identity/v3/projects/8ab14e1312c54c39831acbf8e81f7c9d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:01.600419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1121/2254] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:01 2022] DELETE /identity/v3/users/5da75610b7b849218fc89f4518bbf4cc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:01.605173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c549d2-fc94-4329-96d4-e3bf21824917 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:01.605467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c549d2-fc94-4329-96d4-e3bf21824917 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:01.605757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c549d2-fc94-4329-96d4-e3bf21824917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:01.642476 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-70c549d2-fc94-4329-96d4-e3bf21824917 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:01.643895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-70c549d2-fc94-4329-96d4-e3bf21824917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:01.718487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1134/2255] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:01.729501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:01.731121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:01.793504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:01.797461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df5d6a-078c-4997-981f-39869c83f3f5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:01.802103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c6bc0-74b3-471d-ac1c-048b2c29d413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:01.803239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6bc0-74b3-471d-ac1c-048b2c29d413 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:01.803759 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6bc0-74b3-471d-ac1c-048b2c29d413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:01.804624 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6bc0-74b3-471d-ac1c-048b2c29d413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:01.815417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c6bc0-74b3-471d-ac1c-048b2c29d413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:01.817471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c6bc0-74b3-471d-ac1c-048b2c29d413 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:01.829339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1122/2256] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:02.234206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c549d2-fc94-4329-96d4-e3bf21824917 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:02.235766 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-70c549d2-fc94-4329-96d4-e3bf21824917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:02.248139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c549d2-fc94-4329-96d4-e3bf21824917 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:02.254351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:02.255272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:02.255555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:02.255840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] PATH_INFO: `/v3/projects/0e0de974dc064172941811cc63d8a1e1` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:02.257050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0de974dc064172941811cc63d8a1e1)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:02.259120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:02.306232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0de974dc064172941811cc63d8a1e1', 'request_id': 'req-eed4f061-5c9b-4848-a3eb-4f29c0a04508'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.311927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0de974dc064172941811cc63d8a1e1', 'request_id': 'req-eed4f061-5c9b-4848-a3eb-4f29c0a04508'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.313011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:02.319642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0de974dc064172941811cc63d8a1e1', 'request_id': 'req-eed4f061-5c9b-4848-a3eb-4f29c0a04508'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.332241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] The token cache is being invalidate because project 0e0de974dc064172941811cc63d8a1e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:02.332533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.333156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.334689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1135/2257] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:02 2022] DELETE /identity/v3/projects/0e0de974dc064172941811cc63d8a1e1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:02.338872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c6bc0-74b3-471d-ac1c-048b2c29d413 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:02.349032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c6bc0-74b3-471d-ac1c-048b2c29d413 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:02.403558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:02.404422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:02.404709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:02.405007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] PATH_INFO: `/v3/users/8d65cf303472458bb444da3ba99cd225` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:02.406649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d65cf303472458bb444da3ba99cd225)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:02.408589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:02.453789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d65cf303472458bb444da3ba99cd225'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.454704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d65cf303472458bb444da3ba99cd225'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.462821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d65cf303472458bb444da3ba99cd225'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.470846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d65cf303472458bb444da3ba99cd225'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.486864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cf627f60-1cd7-4a17-ac80-8ba7debb8de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d65cf303472458bb444da3ba99cd225'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.493001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1123/2258] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:02 2022] DELETE /identity/v3/users/8d65cf303472458bb444da3ba99cd225 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:02.771680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:02.773298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:02.808735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4f061-5c9b-4848-a3eb-4f29c0a04508 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:02.869892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:02.870796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:02.871092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:02.871372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] PATH_INFO: `/v3/projects/c2923eac011d4481aad48446af588447` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:02.872558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2923eac011d4481aad48446af588447)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:02.874485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:02.922047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2923eac011d4481aad48446af588447', 'request_id': 'req-4d0042d8-625b-4d58-bc79-f5c659763b10'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.931162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2923eac011d4481aad48446af588447', 'request_id': 'req-4d0042d8-625b-4d58-bc79-f5c659763b10'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.938980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2923eac011d4481aad48446af588447', 'request_id': 'req-4d0042d8-625b-4d58-bc79-f5c659763b10'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.952121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] The token cache is being invalidate because project c2923eac011d4481aad48446af588447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:02.952351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.952981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-4d0042d8-625b-4d58-bc79-f5c659763b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:02.954521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1136/2259] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:02 2022] DELETE /identity/v3/projects/c2923eac011d4481aad48446af588447 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:02.959567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f901-ee66-4687-848f-e96ee5e9c961 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:02.960035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f901-ee66-4687-848f-e96ee5e9c961 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:02.960262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f901-ee66-4687-848f-e96ee5e9c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:02.978631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e932f901-ee66-4687-848f-e96ee5e9c961 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:02.979980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e932f901-ee66-4687-848f-e96ee5e9c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:03.056481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1124/2260] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:03.064026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd10d-2b4d-4ab6-b009-6c38b844a3b7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.064323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd10d-2b4d-4ab6-b009-6c38b844a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.064606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd10d-2b4d-4ab6-b009-6c38b844a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.083610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-849dd10d-2b4d-4ab6-b009-6c38b844a3b7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:03.084840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-849dd10d-2b4d-4ab6-b009-6c38b844a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:03.093814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1137/2261] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:03.098024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f901-ee66-4687-848f-e96ee5e9c961 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.108088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f901-ee66-4687-848f-e96ee5e9c961 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.113565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.114237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.114528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.114907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.115646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:35:03.115957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.117567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.125108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:03.135163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1125/2262] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:35:03.136177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd10d-2b4d-4ab6-b009-6c38b844a3b7 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.146600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd10d-2b4d-4ab6-b009-6c38b844a3b7 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.151842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ba7f6-fa19-4b74-aa6c-ff66355381af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.152514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ba7f6-fa19-4b74-aa6c-ff66355381af admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.152801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ba7f6-fa19-4b74-aa6c-ff66355381af admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.153078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ba7f6-fa19-4b74-aa6c-ff66355381af admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.153883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ba7f6-fa19-4b74-aa6c-ff66355381af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.156250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ba7f6-fa19-4b74-aa6c-ff66355381af admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.185680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1138/2263] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:03 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:03.190268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.208045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217f350-27e1-4ee6-bb5e-9f15fd236fb4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.295186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9803-8144-4197-92e0-c2c334891156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.296551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9803-8144-4197-92e0-c2c334891156 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.296551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9803-8144-4197-92e0-c2c334891156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.296754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9803-8144-4197-92e0-c2c334891156 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.297415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb9803-8144-4197-92e0-c2c334891156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.299413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb9803-8144-4197-92e0-c2c334891156 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.324367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1126/2264] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:03 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:35:03.326998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ba7f6-fa19-4b74-aa6c-ff66355381af admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.339219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ba7f6-fa19-4b74-aa6c-ff66355381af admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.344894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c9a89-cc2a-4af4-b954-68195ea63348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.345747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c9a89-cc2a-4af4-b954-68195ea63348 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.346037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c9a89-cc2a-4af4-b954-68195ea63348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.346348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c9a89-cc2a-4af4-b954-68195ea63348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.347352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c9a89-cc2a-4af4-b954-68195ea63348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.348952 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c9a89-cc2a-4af4-b954-68195ea63348 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.361557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1139/2265] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:03.365601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9803-8144-4197-92e0-c2c334891156 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.378237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9803-8144-4197-92e0-c2c334891156 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.383904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253981d-b5cf-41a6-8120-5a24b8a6b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.384983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253981d-b5cf-41a6-8120-5a24b8a6b785 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.385170 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253981d-b5cf-41a6-8120-5a24b8a6b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.385595 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253981d-b5cf-41a6-8120-5a24b8a6b785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.386371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253981d-b5cf-41a6-8120-5a24b8a6b785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.388321 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253981d-b5cf-41a6-8120-5a24b8a6b785 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.403331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1127/2266] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:03.407691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c9a89-cc2a-4af4-b954-68195ea63348 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.420705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c9a89-cc2a-4af4-b954-68195ea63348 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.427200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b72b-afa1-4316-8b56-0443ea8f3a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.428110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b72b-afa1-4316-8b56-0443ea8f3a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.428417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b72b-afa1-4316-8b56-0443ea8f3a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.428830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463b72b-afa1-4316-8b56-0443ea8f3a69 admin admin] PATH_INFO: `/v3/projects/4a6ba897440d43699a0e5eba828c0347/users/40e3d24c11db42e69acc8793aeffd411/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.449746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463b72b-afa1-4316-8b56-0443ea8f3a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6ba897440d43699a0e5eba828c0347, user_id=40e3d24c11db42e69acc8793aeffd411, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.455010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463b72b-afa1-4316-8b56-0443ea8f3a69 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.487350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1140/2267] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:03 2022] PUT /identity/v3/projects/4a6ba897440d43699a0e5eba828c0347/users/40e3d24c11db42e69acc8793aeffd411/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:03.490500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea182a9f-b44e-4a26-9356-65ffdf11d27c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.491101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea182a9f-b44e-4a26-9356-65ffdf11d27c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.491391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea182a9f-b44e-4a26-9356-65ffdf11d27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.520322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ea182a9f-b44e-4a26-9356-65ffdf11d27c None None] MFA Rules not processed for user `40e3d24c11db42e69acc8793aeffd411`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:03.521578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ea182a9f-b44e-4a26-9356-65ffdf11d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:03.589108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1128/2268] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:03.593686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b72b-afa1-4316-8b56-0443ea8f3a69 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.607170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:03.658001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463b72b-afa1-4316-8b56-0443ea8f3a69 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.663271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e923e61-3db3-466e-8500-9d165dc40f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.663984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e923e61-3db3-466e-8500-9d165dc40f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.664273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e923e61-3db3-466e-8500-9d165dc40f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.664670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e923e61-3db3-466e-8500-9d165dc40f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.665411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e923e61-3db3-466e-8500-9d165dc40f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.667384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e923e61-3db3-466e-8500-9d165dc40f29 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.692862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1141/2269] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:03 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:03.697108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea182a9f-b44e-4a26-9356-65ffdf11d27c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.707570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea182a9f-b44e-4a26-9356-65ffdf11d27c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.764609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06e814-d4bb-4032-9ca4-b3fd2ff637be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.765314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06e814-d4bb-4032-9ca4-b3fd2ff637be admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.765598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06e814-d4bb-4032-9ca4-b3fd2ff637be admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.765874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06e814-d4bb-4032-9ca4-b3fd2ff637be admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.766564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06e814-d4bb-4032-9ca4-b3fd2ff637be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.768501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06e814-d4bb-4032-9ca4-b3fd2ff637be admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.778028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:03.794532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1129/2270] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:03 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:35:03.798888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e923e61-3db3-466e-8500-9d165dc40f29 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.809606 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e923e61-3db3-466e-8500-9d165dc40f29 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.814350 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dea63-1e8f-498f-bbb3-7b5f6451807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.815123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dea63-1e8f-498f-bbb3-7b5f6451807e admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.815421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dea63-1e8f-498f-bbb3-7b5f6451807e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.815706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dea63-1e8f-498f-bbb3-7b5f6451807e admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.816467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dea63-1e8f-498f-bbb3-7b5f6451807e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.818112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dea63-1e8f-498f-bbb3-7b5f6451807e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.829002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1142/2271] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:03.833088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06e814-d4bb-4032-9ca4-b3fd2ff637be admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.843577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06e814-d4bb-4032-9ca4-b3fd2ff637be admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.848200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527dc1-aebc-476b-b38d-09714d77740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.849096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527dc1-aebc-476b-b38d-09714d77740d admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.849388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527dc1-aebc-476b-b38d-09714d77740d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.849671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527dc1-aebc-476b-b38d-09714d77740d admin admin] PATH_INFO: `/v3/projects/839fd710392141858764de025f481afe/users/b556ba48d868453dba7eefb6927c6b7a/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.865910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527dc1-aebc-476b-b38d-09714d77740d admin admin] RBAC: Authorizing `identity:create_grant(project_id=839fd710392141858764de025f481afe, user_id=b556ba48d868453dba7eefb6927c6b7a, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.868727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527dc1-aebc-476b-b38d-09714d77740d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.882600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1130/2272] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:03 2022] PUT /identity/v3/projects/839fd710392141858764de025f481afe/users/b556ba48d868453dba7eefb6927c6b7a/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:03.887450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dea63-1e8f-498f-bbb3-7b5f6451807e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.897957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dea63-1e8f-498f-bbb3-7b5f6451807e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.962201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7bb0c-74b8-44f1-a2e5-cb566231b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.962923 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bb0c-74b8-44f1-a2e5-cb566231b0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.963211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bb0c-74b8-44f1-a2e5-cb566231b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.963489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bb0c-74b8-44f1-a2e5-cb566231b0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:03.964210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7bb0c-74b8-44f1-a2e5-cb566231b0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:03.965813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7bb0c-74b8-44f1-a2e5-cb566231b0b5 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:03.976473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1143/2273] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:35:03.980593 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527dc1-aebc-476b-b38d-09714d77740d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:03.992527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527dc1-aebc-476b-b38d-09714d77740d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:03.996847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:03.997853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:03.998170 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:03.998477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] PATH_INFO: `/v3/projects/839fd710392141858764de025f481afe/users/b556ba48d868453dba7eefb6927c6b7a/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.000510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=839fd710392141858764de025f481afe, user_id=b556ba48d868453dba7eefb6927c6b7a, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:04.003171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:04.014230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1131/2274] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:03 2022] PUT /identity/v3/projects/839fd710392141858764de025f481afe/users/b556ba48d868453dba7eefb6927c6b7a/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:04.024068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210ad2-abee-4ca0-a3bc-cfca37d7957b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.024366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210ad2-abee-4ca0-a3bc-cfca37d7957b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.024649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210ad2-abee-4ca0-a3bc-cfca37d7957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.067333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-0a210ad2-abee-4ca0-a3bc-cfca37d7957b None None] MFA Rules not processed for user `b556ba48d868453dba7eefb6927c6b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:04.067925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0a210ad2-abee-4ca0-a3bc-cfca37d7957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.114512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:04.116269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.144678 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1144/2275] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:04.155780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210ad2-abee-4ca0-a3bc-cfca37d7957b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:04.157102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0a210ad2-abee-4ca0-a3bc-cfca37d7957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.168533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:04.184525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9626a-aea2-45ee-b4ab-a2ec70a549ed admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:04.189562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:04.190455 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.190720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.191028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] PATH_INFO: `/v3/users/7cc050e046784e439ed7117f1d6be42e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.192234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc050e046784e439ed7117f1d6be42e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:04.194158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:04.217524 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210ad2-abee-4ca0-a3bc-cfca37d7957b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:04.222858 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ec455-95c5-468e-a69a-abbf0fc5b1b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:04.223838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec455-95c5-468e-a69a-abbf0fc5b1b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.224066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec455-95c5-468e-a69a-abbf0fc5b1b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.224369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec455-95c5-468e-a69a-abbf0fc5b1b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.234397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ec455-95c5-468e-a69a-abbf0fc5b1b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:04.235875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ec455-95c5-468e-a69a-abbf0fc5b1b3 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:04.240939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc050e046784e439ed7117f1d6be42e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.241603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc050e046784e439ed7117f1d6be42e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.245428 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1145/2276] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:35:04.248948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc050e046784e439ed7117f1d6be42e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.256745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc050e046784e439ed7117f1d6be42e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.269976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc050e046784e439ed7117f1d6be42e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.276189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1132/2277] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:04 2022] DELETE /identity/v3/users/7cc050e046784e439ed7117f1d6be42e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:04.280514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061cc77-bad6-4d75-b76d-94f468533503 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.280878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061cc77-bad6-4d75-b76d-94f468533503 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.281326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061cc77-bad6-4d75-b76d-94f468533503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.301596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4061cc77-bad6-4d75-b76d-94f468533503 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:04.303013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4061cc77-bad6-4d75-b76d-94f468533503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.375884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1146/2278] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:04.376034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:04.376719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.382230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061cc77-bad6-4d75-b76d-94f468533503 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:04.383586 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4061cc77-bad6-4d75-b76d-94f468533503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.390616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e8a46-af0d-4609-943f-7f7c34272432 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:04.395253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:04.396121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.396405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.396680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] PATH_INFO: `/v3/users/40e3d24c11db42e69acc8793aeffd411` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.398027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e3d24c11db42e69acc8793aeffd411)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:04.400038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:04.436162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:04.443207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061cc77-bad6-4d75-b76d-94f468533503 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:04.446742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6ca82-4c7d-4937-bf65-46af61945b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:04.447564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ca82-4c7d-4937-bf65-46af61945b13 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.447857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ca82-4c7d-4937-bf65-46af61945b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.448144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ca82-4c7d-4937-bf65-46af61945b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.453080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e3d24c11db42e69acc8793aeffd411'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.453852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e3d24c11db42e69acc8793aeffd411'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.459061 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6ca82-4c7d-4937-bf65-46af61945b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:04.460674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6ca82-4c7d-4937-bf65-46af61945b13 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:04.462933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e3d24c11db42e69acc8793aeffd411'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.471649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1147/2279] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:35:04.472563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e3d24c11db42e69acc8793aeffd411'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.485872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e3d24c11db42e69acc8793aeffd411'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.493036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1133/2280] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:04 2022] DELETE /identity/v3/users/40e3d24c11db42e69acc8793aeffd411 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:04.497905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83856b-2e3c-4412-8321-22457f90f967 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.498391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83856b-2e3c-4412-8321-22457f90f967 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.498695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83856b-2e3c-4412-8321-22457f90f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.524079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-cd83856b-2e3c-4412-8321-22457f90f967 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:04.525528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-cd83856b-2e3c-4412-8321-22457f90f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.595193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:04.611843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1148/2281] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:04.631685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:04.633147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.717764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724fea3-c1f4-4d88-ad24-0e60e005e3e0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:04.721419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0e777-3c80-4f85-816f-fefa96d0c1a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:04.722077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0e777-3c80-4f85-816f-fefa96d0c1a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.722362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0e777-3c80-4f85-816f-fefa96d0c1a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.722642 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0e777-3c80-4f85-816f-fefa96d0c1a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.731822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0e777-3c80-4f85-816f-fefa96d0c1a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:04.733263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0e777-3c80-4f85-816f-fefa96d0c1a2 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:04.742905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1134/2282] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:04.830283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83856b-2e3c-4412-8321-22457f90f967 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:04.831886 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-cd83856b-2e3c-4412-8321-22457f90f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:04.844739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83856b-2e3c-4412-8321-22457f90f967 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:04.850205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:04.851075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:04.851615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:04.851865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] PATH_INFO: `/v3/projects/7da273fd669146ecb4078308af94bcaa` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:04.853215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da273fd669146ecb4078308af94bcaa)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:04.855473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:04.909742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da273fd669146ecb4078308af94bcaa', 'request_id': 'req-e7f9c264-71a2-43cd-b801-2d52903c681b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.915887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da273fd669146ecb4078308af94bcaa', 'request_id': 'req-e7f9c264-71a2-43cd-b801-2d52903c681b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.922796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da273fd669146ecb4078308af94bcaa', 'request_id': 'req-e7f9c264-71a2-43cd-b801-2d52903c681b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.938797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] The token cache is being invalidate because project 7da273fd669146ecb4078308af94bcaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:04.938948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.939657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:04.944191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1149/2283] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:04 2022] DELETE /identity/v3/projects/7da273fd669146ecb4078308af94bcaa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:04.945884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0e777-3c80-4f85-816f-fefa96d0c1a2 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:04.956097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0e777-3c80-4f85-816f-fefa96d0c1a2 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:05.013783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:05.014737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.015059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.015340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] PATH_INFO: `/v3/users/665f0ae248ed44519815e1510bced04e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.016521 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665f0ae248ed44519815e1510bced04e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:05.018484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:05.057314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:05.058723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:05.072842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9c264-71a2-43cd-b801-2d52903c681b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:05.075344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665f0ae248ed44519815e1510bced04e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.076377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665f0ae248ed44519815e1510bced04e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.077520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:05.078401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.078689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.078996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] PATH_INFO: `/v3/projects/4a6ba897440d43699a0e5eba828c0347` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.080203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a6ba897440d43699a0e5eba828c0347)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:05.082124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:05.092769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665f0ae248ed44519815e1510bced04e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.095935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:05.106606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665f0ae248ed44519815e1510bced04e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.123461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665f0ae248ed44519815e1510bced04e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.130730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1135/2284] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:04 2022] DELETE /identity/v3/users/665f0ae248ed44519815e1510bced04e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:05.139887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6ba897440d43699a0e5eba828c0347', 'request_id': 'req-fae79c5c-96b9-4230-af87-76740ee6c352'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.145863 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6ba897440d43699a0e5eba828c0347', 'request_id': 'req-fae79c5c-96b9-4230-af87-76740ee6c352'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.152047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6ba897440d43699a0e5eba828c0347', 'request_id': 'req-fae79c5c-96b9-4230-af87-76740ee6c352'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.166148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] The token cache is being invalidate because project 4a6ba897440d43699a0e5eba828c0347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:05.166521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.167276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.168917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1150/2285] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:05 2022] DELETE /identity/v3/projects/4a6ba897440d43699a0e5eba828c0347 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:05.173395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:05.174835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:05.242628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b96155-d618-4d7a-8229-d06007ed58d4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:05.247659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:05.248551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.248842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.249683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] PATH_INFO: `/v3/users/b556ba48d868453dba7eefb6927c6b7a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.250949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b556ba48d868453dba7eefb6927c6b7a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:05.253022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:05.312575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b556ba48d868453dba7eefb6927c6b7a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.313208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b556ba48d868453dba7eefb6927c6b7a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.320105 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b556ba48d868453dba7eefb6927c6b7a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.327735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b556ba48d868453dba7eefb6927c6b7a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.340459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b556ba48d868453dba7eefb6927c6b7a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.348047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1136/2286] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:05 2022] DELETE /identity/v3/users/b556ba48d868453dba7eefb6927c6b7a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:05.496479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:05.498121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:05.573434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae79c5c-96b9-4230-af87-76740ee6c352 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:05.578348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:05.637996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:05.638191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:05.639289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.639582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.639902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] PATH_INFO: `/v3/projects/e9a158a5e92b42ca9fa72f981d544baf` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.640002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:05.641186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a158a5e92b42ca9fa72f981d544baf)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:05.643200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:05.657351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaa89f-8a52-4fe5-bb12-bd548bfca9b6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:05.663734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:05.664979 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.665249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.665648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] PATH_INFO: `/v3/projects/839fd710392141858764de025f481afe` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.666701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839fd710392141858764de025f481afe)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:05.668647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:05.716711 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a158a5e92b42ca9fa72f981d544baf', 'request_id': 'req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.724732 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a158a5e92b42ca9fa72f981d544baf', 'request_id': 'req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.726339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:05.733400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839fd710392141858764de025f481afe', 'request_id': 'req-078a274e-e35d-4820-9d97-e774f86f5ee6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.737654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a158a5e92b42ca9fa72f981d544baf', 'request_id': 'req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.740336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839fd710392141858764de025f481afe', 'request_id': 'req-078a274e-e35d-4820-9d97-e774f86f5ee6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.751639 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839fd710392141858764de025f481afe', 'request_id': 'req-078a274e-e35d-4820-9d97-e774f86f5ee6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.752486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] The token cache is being invalidate because project e9a158a5e92b42ca9fa72f981d544baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:05.752786 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.753448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.755375 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1151/2287] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:05 2022] DELETE /identity/v3/projects/e9a158a5e92b42ca9fa72f981d544baf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:05.759554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:05.761693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:05.769067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] The token cache is being invalidate because project 839fd710392141858764de025f481afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:05.769599 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.771230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-078a274e-e35d-4820-9d97-e774f86f5ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:05.774569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1137/2288] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:05 2022] DELETE /identity/v3/projects/839fd710392141858764de025f481afe => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:05.779122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98136244-e3f6-4b66-ae64-81cd75023057 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.779632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98136244-e3f6-4b66-ae64-81cd75023057 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.780100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98136244-e3f6-4b66-ae64-81cd75023057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.802331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-98136244-e3f6-4b66-ae64-81cd75023057 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:05.803857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-98136244-e3f6-4b66-ae64-81cd75023057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:05.849734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b951ef-f0b8-4dd6-97c5-7b9c57d4867d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:05.890824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1138/2289] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:05.896005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d51435-3216-47d9-869c-015c286e290e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.896246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d51435-3216-47d9-869c-015c286e290e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.896645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d51435-3216-47d9-869c-015c286e290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.919041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:05.934937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-23d51435-3216-47d9-869c-015c286e290e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:05.936544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-23d51435-3216-47d9-869c-015c286e290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:05.942647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:05.943640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.943997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.944370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] PATH_INFO: `/v3/users/10e00377f308448a9bfd760504f8c872` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.948716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e00377f308448a9bfd760504f8c872)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:05.949135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1139/2290] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:05.949239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:05.953700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d51435-3216-47d9-869c-015c286e290e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:05.966637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d51435-3216-47d9-869c-015c286e290e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:05.973396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:05.975204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:05.975699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:05.976014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:05.976745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:35:05.977145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:05.979030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:05.992481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1140/2291] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:35:05.997092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.005401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e00377f308448a9bfd760504f8c872'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.009110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f5425-2565-4417-87a9-6212bbb6db46 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.014216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e94b7-6fcd-4adf-87b0-4ec5493b031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.015696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e94b7-6fcd-4adf-87b0-4ec5493b031e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.015845 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e94b7-6fcd-4adf-87b0-4ec5493b031e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.016016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e94b7-6fcd-4adf-87b0-4ec5493b031e admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.016719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e94b7-6fcd-4adf-87b0-4ec5493b031e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.018650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e94b7-6fcd-4adf-87b0-4ec5493b031e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.021059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e00377f308448a9bfd760504f8c872'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.021791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e00377f308448a9bfd760504f8c872'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.033358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e00377f308448a9bfd760504f8c872'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.043511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e00377f308448a9bfd760504f8c872'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.056879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1152/2292] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:05 2022] DELETE /identity/v3/users/10e00377f308448a9bfd760504f8c872 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:06.064366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1141/2293] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:05 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:06.069836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.071953 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:06.162940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab588949-6ba1-4746-94af-6e0fc952934a admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.256505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0289-617e-4c66-ba63-5e1eeb22e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.257221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0289-617e-4c66-ba63-5e1eeb22e389 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.257514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0289-617e-4c66-ba63-5e1eeb22e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.257799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0289-617e-4c66-ba63-5e1eeb22e389 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.258511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0289-617e-4c66-ba63-5e1eeb22e389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.260571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0289-617e-4c66-ba63-5e1eeb22e389 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.286755 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1153/2294] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:06 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:06.290486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e94b7-6fcd-4adf-87b0-4ec5493b031e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.305263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e94b7-6fcd-4adf-87b0-4ec5493b031e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.310946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780690b1-be53-42b8-9297-2cfb9e6e272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.313001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780690b1-be53-42b8-9297-2cfb9e6e272d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.313487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780690b1-be53-42b8-9297-2cfb9e6e272d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.313919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780690b1-be53-42b8-9297-2cfb9e6e272d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.314920 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780690b1-be53-42b8-9297-2cfb9e6e272d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.317247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780690b1-be53-42b8-9297-2cfb9e6e272d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.334302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1142/2295] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:35:06.337111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0289-617e-4c66-ba63-5e1eeb22e389 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.350643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:06.360220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0289-617e-4c66-ba63-5e1eeb22e389 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.371619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.372466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.372763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.373075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.374801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.377706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.391869 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1154/2296] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:06.396155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780690b1-be53-42b8-9297-2cfb9e6e272d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.411130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780690b1-be53-42b8-9297-2cfb9e6e272d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.416347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.418928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:06.435198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77732e21-7edd-4d06-8901-f2d0fcde6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.435401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f521-1375-4024-8800-b945a1103b56 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.437922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732e21-7edd-4d06-8901-f2d0fcde6ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.438426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732e21-7edd-4d06-8901-f2d0fcde6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.439026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732e21-7edd-4d06-8901-f2d0fcde6ccb admin admin] PATH_INFO: `/v3/projects/cc9e18f103844d359c860b48938c33a5/users/d5fbcac30273462391f352775cd1fb1d/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.441345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.442653 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.443337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.443456 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] PATH_INFO: `/v3/projects/e1ade463320b4d559e3c96ae8dc24631` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.445006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ade463320b4d559e3c96ae8dc24631)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.447047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.467247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77732e21-7edd-4d06-8901-f2d0fcde6ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9e18f103844d359c860b48938c33a5, user_id=d5fbcac30273462391f352775cd1fb1d, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.472263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77732e21-7edd-4d06-8901-f2d0fcde6ccb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.489933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1143/2297] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:06 2022] PUT /identity/v3/projects/cc9e18f103844d359c860b48938c33a5/users/d5fbcac30273462391f352775cd1fb1d/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:06.501822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081f9c7-ba6f-4679-88a2-94607bff1950 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.502179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081f9c7-ba6f-4679-88a2-94607bff1950 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.502479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081f9c7-ba6f-4679-88a2-94607bff1950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.516274 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ade463320b4d559e3c96ae8dc24631', 'request_id': 'req-61eedaef-60a2-41b3-b76c-06577a518616'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.525179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ade463320b4d559e3c96ae8dc24631', 'request_id': 'req-61eedaef-60a2-41b3-b76c-06577a518616'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.531029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0081f9c7-ba6f-4679-88a2-94607bff1950 None None] MFA Rules not processed for user `d5fbcac30273462391f352775cd1fb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:06.532473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0081f9c7-ba6f-4679-88a2-94607bff1950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:06.532616 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ade463320b4d559e3c96ae8dc24631', 'request_id': 'req-61eedaef-60a2-41b3-b76c-06577a518616'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.551136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] The token cache is being invalidate because project e1ade463320b4d559e3c96ae8dc24631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:06.551435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.552114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-61eedaef-60a2-41b3-b76c-06577a518616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:06.554515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1155/2298] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:06 2022] DELETE /identity/v3/projects/e1ade463320b4d559e3c96ae8dc24631 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:06.559867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29938c-abc8-49f1-b00a-f6ed8c4b7105 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.560238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29938c-abc8-49f1-b00a-f6ed8c4b7105 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.560596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29938c-abc8-49f1-b00a-f6ed8c4b7105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.583321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5a29938c-abc8-49f1-b00a-f6ed8c4b7105 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:06.584618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5a29938c-abc8-49f1-b00a-f6ed8c4b7105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:06.602866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:06.642562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1144/2299] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:06.646941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081f9c7-ba6f-4679-88a2-94607bff1950 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.648743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0081f9c7-ba6f-4679-88a2-94607bff1950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:06.692970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1156/2300] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:06.702671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0d0d-b2a8-44c4-9280-0d6661ccf022 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.703205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0d0d-b2a8-44c4-9280-0d6661ccf022 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.703489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b0d0d-b2a8-44c4-9280-0d6661ccf022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.727838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-336b0d0d-b2a8-44c4-9280-0d6661ccf022 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:06.728044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081f9c7-ba6f-4679-88a2-94607bff1950 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.729090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-336b0d0d-b2a8-44c4-9280-0d6661ccf022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:06.732854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f078d5b-1b3a-4c61-8217-d2f6aa60a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.733596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f078d5b-1b3a-4c61-8217-d2f6aa60a017 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.733918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f078d5b-1b3a-4c61-8217-d2f6aa60a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.734211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f078d5b-1b3a-4c61-8217-d2f6aa60a017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.734941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f078d5b-1b3a-4c61-8217-d2f6aa60a017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.736908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f078d5b-1b3a-4c61-8217-d2f6aa60a017 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.738605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1157/2301] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:06.742749 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b0d0d-b2a8-44c4-9280-0d6661ccf022 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.752640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b0d0d-b2a8-44c4-9280-0d6661ccf022 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.757744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.758414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.758698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.759004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.759730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:35:06.760042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.761822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.767358 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1145/2302] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:06 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:06.771404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f078d5b-1b3a-4c61-8217-d2f6aa60a017 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.776328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1158/2303] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:35:06.781121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.791985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007df828-193d-4dab-8a1a-10091bb4881c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.843109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f078d5b-1b3a-4c61-8217-d2f6aa60a017 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.850808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:06.851453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f846af-9969-4459-97ba-2b0fc6c8a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.852401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f846af-9969-4459-97ba-2b0fc6c8a1ee admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.853143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f846af-9969-4459-97ba-2b0fc6c8a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.853721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f846af-9969-4459-97ba-2b0fc6c8a1ee admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.854584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f846af-9969-4459-97ba-2b0fc6c8a1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.857717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f846af-9969-4459-97ba-2b0fc6c8a1ee admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.860098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c608-f51d-4dbd-b479-96c7b6c13c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.861101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c608-f51d-4dbd-b479-96c7b6c13c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.861518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c608-f51d-4dbd-b479-96c7b6c13c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.862029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c608-f51d-4dbd-b479-96c7b6c13c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.862962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7c608-f51d-4dbd-b479-96c7b6c13c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.866634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7c608-f51d-4dbd-b479-96c7b6c13c15 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.886987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1146/2304] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:06 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:35:06.890380 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f846af-9969-4459-97ba-2b0fc6c8a1ee admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.898136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1159/2305] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:06 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:35:06.901840 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f846af-9969-4459-97ba-2b0fc6c8a1ee admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:06.902206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c608-f51d-4dbd-b479-96c7b6c13c15 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:06.979469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5e599-9df8-41e8-af9a-c671dabc2c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:06.980308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5e599-9df8-41e8-af9a-c671dabc2c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:06.980919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5e599-9df8-41e8-af9a-c671dabc2c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:06.981298 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5e599-9df8-41e8-af9a-c671dabc2c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:06.982116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5e599-9df8-41e8-af9a-c671dabc2c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:06.984815 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5e599-9df8-41e8-af9a-c671dabc2c72 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:06.987028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:07.003444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1147/2306] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:35:07.006967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5e599-9df8-41e8-af9a-c671dabc2c72 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:07.011099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c608-f51d-4dbd-b479-96c7b6c13c15 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.017678 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d71ed7-64db-4784-a20e-1f3e4e9b32c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.018450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d71ed7-64db-4784-a20e-1f3e4e9b32c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.018959 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d71ed7-64db-4784-a20e-1f3e4e9b32c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.019188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d71ed7-64db-4784-a20e-1f3e4e9b32c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.019958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d71ed7-64db-4784-a20e-1f3e4e9b32c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.022760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d71ed7-64db-4784-a20e-1f3e4e9b32c7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.038967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5e599-9df8-41e8-af9a-c671dabc2c72 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.048814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c499f-d1f7-42cb-9bf2-be564fb61cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.050068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c499f-d1f7-42cb-9bf2-be564fb61cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.050485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c499f-d1f7-42cb-9bf2-be564fb61cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.050760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c499f-d1f7-42cb-9bf2-be564fb61cb5 admin admin] PATH_INFO: `/v3/projects/e508a0633b3546f8968516672f4b600d/users/65476f4fcf7b4478a0af4e21f9c983eb/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.078192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1160/2307] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:06 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:35:07.082420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d71ed7-64db-4784-a20e-1f3e4e9b32c7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:07.096409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d71ed7-64db-4784-a20e-1f3e4e9b32c7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.099995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c499f-d1f7-42cb-9bf2-be564fb61cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e508a0633b3546f8968516672f4b600d, user_id=65476f4fcf7b4478a0af4e21f9c983eb, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.102882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484de33-fcd4-4c4c-86a6-a6cbd0269607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.103822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484de33-fcd4-4c4c-86a6-a6cbd0269607 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.104221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484de33-fcd4-4c4c-86a6-a6cbd0269607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.104636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484de33-fcd4-4c4c-86a6-a6cbd0269607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.105626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484de33-fcd4-4c4c-86a6-a6cbd0269607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.106798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c499f-d1f7-42cb-9bf2-be564fb61cb5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.107655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484de33-fcd4-4c4c-86a6-a6cbd0269607 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.119856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1161/2308] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:07.124772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484de33-fcd4-4c4c-86a6-a6cbd0269607 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:07.137312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484de33-fcd4-4c4c-86a6-a6cbd0269607 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.137831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1148/2309] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:07 2022] PUT /identity/v3/projects/e508a0633b3546f8968516672f4b600d/users/65476f4fcf7b4478a0af4e21f9c983eb/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:07.143873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c499f-d1f7-42cb-9bf2-be564fb61cb5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:07.222716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d3193-aa7b-4892-a124-9cbbb52305f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.226857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d3193-aa7b-4892-a124-9cbbb52305f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.226857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d3193-aa7b-4892-a124-9cbbb52305f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.226857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d3193-aa7b-4892-a124-9cbbb52305f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.226857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d3193-aa7b-4892-a124-9cbbb52305f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.226857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d3193-aa7b-4892-a124-9cbbb52305f2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.243106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1162/2310] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:07.247822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d3193-aa7b-4892-a124-9cbbb52305f2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:07.258757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c499f-d1f7-42cb-9bf2-be564fb61cb5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.263889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d3193-aa7b-4892-a124-9cbbb52305f2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.264803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fad7fc-8b3b-4fc3-844a-160ffd3c066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.265476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fad7fc-8b3b-4fc3-844a-160ffd3c066d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.265772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fad7fc-8b3b-4fc3-844a-160ffd3c066d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.266058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fad7fc-8b3b-4fc3-844a-160ffd3c066d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.266932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fad7fc-8b3b-4fc3-844a-160ffd3c066d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.268921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fad7fc-8b3b-4fc3-844a-160ffd3c066d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.272097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b1e84-225a-4658-a55c-f13cae73dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.273298 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1e84-225a-4658-a55c-f13cae73dbab admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.273819 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1e84-225a-4658-a55c-f13cae73dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.274222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1e84-225a-4658-a55c-f13cae73dbab admin admin] PATH_INFO: `/v3/projects/2332fd905cb54681a13f3197f86cc09b/users/c164fd40f2a14b428eda1e74153e2fad/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.281480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1149/2311] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:35:07.288830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fad7fc-8b3b-4fc3-844a-160ffd3c066d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:07.302536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fad7fc-8b3b-4fc3-844a-160ffd3c066d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.304769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b1e84-225a-4658-a55c-f13cae73dbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2332fd905cb54681a13f3197f86cc09b, user_id=c164fd40f2a14b428eda1e74153e2fad, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.308667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b1e84-225a-4658-a55c-f13cae73dbab admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.308992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea3f8c-ec2a-47d7-82cc-3a6d26936ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.310381 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea3f8c-ec2a-47d7-82cc-3a6d26936ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.311214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea3f8c-ec2a-47d7-82cc-3a6d26936ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.311214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea3f8c-ec2a-47d7-82cc-3a6d26936ad3 admin admin] PATH_INFO: `/v3/projects/e508a0633b3546f8968516672f4b600d/users/65476f4fcf7b4478a0af4e21f9c983eb/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.314385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea3f8c-ec2a-47d7-82cc-3a6d26936ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e508a0633b3546f8968516672f4b600d, user_id=65476f4fcf7b4478a0af4e21f9c983eb, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.318196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea3f8c-ec2a-47d7-82cc-3a6d26936ad3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.328418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1163/2312] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:07 2022] PUT /identity/v3/projects/2332fd905cb54681a13f3197f86cc09b/users/c164fd40f2a14b428eda1e74153e2fad/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:07.339089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc9dd-4f64-4595-938a-0d3476e219da None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.339737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1150/2313] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:07 2022] PUT /identity/v3/projects/e508a0633b3546f8968516672f4b600d/users/65476f4fcf7b4478a0af4e21f9c983eb/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:07.339875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc9dd-4f64-4595-938a-0d3476e219da None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.340051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc9dd-4f64-4595-938a-0d3476e219da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.349940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204919a-e0d8-4a06-8836-b736bbafa614 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.350252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204919a-e0d8-4a06-8836-b736bbafa614 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.350519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204919a-e0d8-4a06-8836-b736bbafa614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.375876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-68fdc9dd-4f64-4595-938a-0d3476e219da None None] MFA Rules not processed for user `c164fd40f2a14b428eda1e74153e2fad`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:07.376692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-68fdc9dd-4f64-4595-938a-0d3476e219da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:07.383629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2204919a-e0d8-4a06-8836-b736bbafa614 None None] MFA Rules not processed for user `65476f4fcf7b4478a0af4e21f9c983eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:07.385143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2204919a-e0d8-4a06-8836-b736bbafa614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:07.397103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:07.455780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1164/2314] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:07.467575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc9dd-4f64-4595-938a-0d3476e219da None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:07.468099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1151/2315] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:07.469012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-68fdc9dd-4f64-4595-938a-0d3476e219da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:07.478957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204919a-e0d8-4a06-8836-b736bbafa614 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:07.480800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2204919a-e0d8-4a06-8836-b736bbafa614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:07.527219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:07.532416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc9dd-4f64-4595-938a-0d3476e219da None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.536782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f1a7c-4519-4f9d-9370-1586a444d318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.537482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1a7c-4519-4f9d-9370-1586a444d318 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.537772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1a7c-4519-4f9d-9370-1586a444d318 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.538039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1a7c-4519-4f9d-9370-1586a444d318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.542345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204919a-e0d8-4a06-8836-b736bbafa614 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:07.546478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:07.547105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f1a7c-4519-4f9d-9370-1586a444d318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.547215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.547435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.547741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.548544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f1a7c-4519-4f9d-9370-1586a444d318 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.557252 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1165/2316] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:35:07.612246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:07.613712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:07.628152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcce84-9edb-4517-a749-11db30c264a2 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:07.628378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcce84-9edb-4517-a749-11db30c264a2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:07.628797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcce84-9edb-4517-a749-11db30c264a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:07.632747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1152/2317] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:35:07.648896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-5fdcce84-9edb-4517-a749-11db30c264a2 None None] MFA Rules not processed for user `195821093293441abe4768162a6fe5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:07.650189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5fdcce84-9edb-4517-a749-11db30c264a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:07.715101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1166/2318] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:09.298707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:09.300347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:09.377589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170853f-b725-49df-aee4-c635adbbd369 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:09.382868 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:09.384221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:09.384517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:09.384918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] PATH_INFO: `/v3/users/32971b64c80e494c935b097e92679a1a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:09.387954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32971b64c80e494c935b097e92679a1a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:09.392016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:09.491424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32971b64c80e494c935b097e92679a1a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:09.492445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32971b64c80e494c935b097e92679a1a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:09.503448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32971b64c80e494c935b097e92679a1a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:09.518716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32971b64c80e494c935b097e92679a1a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:09.552232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32971b64c80e494c935b097e92679a1a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:09.565499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1153/2319] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:09 2022] DELETE /identity/v3/users/32971b64c80e494c935b097e92679a1a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:09.570192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb64d-007c-4277-95ce-2ca2a31e6f8a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:09.570738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb64d-007c-4277-95ce-2ca2a31e6f8a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:09.571001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb64d-007c-4277-95ce-2ca2a31e6f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:09.592645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-eebfb64d-007c-4277-95ce-2ca2a31e6f8a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:09.595039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eebfb64d-007c-4277-95ce-2ca2a31e6f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:09.673705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1167/2320] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:09.686606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:09.689009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:09.714922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:09.765159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c81f3-958c-43de-8063-9c4eaae238d0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:09.769172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:09.769842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:09.770132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:09.770418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:09.791012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:09.793252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:09.807490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1154/2321] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:10.238318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb64d-007c-4277-95ce-2ca2a31e6f8a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.240282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eebfb64d-007c-4277-95ce-2ca2a31e6f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:10.252155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb64d-007c-4277-95ce-2ca2a31e6f8a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.257814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.259922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.260543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.260997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] PATH_INFO: `/v3/users/d5fbcac30273462391f352775cd1fb1d` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.263940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fbcac30273462391f352775cd1fb1d)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:10.264528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:10.269330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:10.287206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.289732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:10.307915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0be10d-22b9-42ff-8dd7-34fed7c82935 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.314173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.315188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.315568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.316120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] PATH_INFO: `/v3/projects/2c9c7cb6658149109f94420a66b7961c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.317373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9c7cb6658149109f94420a66b7961c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:10.320220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:10.356478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fbcac30273462391f352775cd1fb1d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.371299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fbcac30273462391f352775cd1fb1d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.372055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fbcac30273462391f352775cd1fb1d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.376993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9c7cb6658149109f94420a66b7961c', 'request_id': 'req-4ced1237-f08d-4814-b543-ccc135c58ba2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.381417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fbcac30273462391f352775cd1fb1d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.384401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9c7cb6658149109f94420a66b7961c', 'request_id': 'req-4ced1237-f08d-4814-b543-ccc135c58ba2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.388989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-06bdd058-71fe-48a1-a3d6-97b60dbc5e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fbcac30273462391f352775cd1fb1d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.391896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9c7cb6658149109f94420a66b7961c', 'request_id': 'req-4ced1237-f08d-4814-b543-ccc135c58ba2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.396108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1168/2322] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:10 2022] DELETE /identity/v3/users/d5fbcac30273462391f352775cd1fb1d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:10.400768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b2165-fd51-4218-846f-35d1a60fa40d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.401173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b2165-fd51-4218-846f-35d1a60fa40d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.401537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b2165-fd51-4218-846f-35d1a60fa40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.410310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] The token cache is being invalidate because project 2c9c7cb6658149109f94420a66b7961c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:10.410898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.411720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4ced1237-f08d-4814-b543-ccc135c58ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:10.413459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1155/2323] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:10 2022] DELETE /identity/v3/projects/2c9c7cb6658149109f94420a66b7961c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:10.418266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778676a-f5ed-4b0a-8558-aacab5b21f02 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.418934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778676a-f5ed-4b0a-8558-aacab5b21f02 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.419295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778676a-f5ed-4b0a-8558-aacab5b21f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.423179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-c52b2165-fd51-4218-846f-35d1a60fa40d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:10.424393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c52b2165-fd51-4218-846f-35d1a60fa40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:10.440139 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3778676a-f5ed-4b0a-8558-aacab5b21f02 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:10.441089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3778676a-f5ed-4b0a-8558-aacab5b21f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:10.504328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1169/2324] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:10.514045 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b2165-fd51-4218-846f-35d1a60fa40d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.518184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c52b2165-fd51-4218-846f-35d1a60fa40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:10.526810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1156/2325] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:10.593771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97424ae-ed65-43e5-86fa-89df0141411e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.594070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97424ae-ed65-43e5-86fa-89df0141411e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.594356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97424ae-ed65-43e5-86fa-89df0141411e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.619319 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a97424ae-ed65-43e5-86fa-89df0141411e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:10.620674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a97424ae-ed65-43e5-86fa-89df0141411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:10.626614 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b2165-fd51-4218-846f-35d1a60fa40d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.630575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1157/2326] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:10.634348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c46eb-ec57-48df-b1eb-6ee6d45ae24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.635375 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c46eb-ec57-48df-b1eb-6ee6d45ae24d service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.635777 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c46eb-ec57-48df-b1eb-6ee6d45ae24d service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.636066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c46eb-ec57-48df-b1eb-6ee6d45ae24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.636316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97424ae-ed65-43e5-86fa-89df0141411e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.648811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97424ae-ed65-43e5-86fa-89df0141411e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.653235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c46eb-ec57-48df-b1eb-6ee6d45ae24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:10.654266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.655128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.655289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c46eb-ec57-48df-b1eb-6ee6d45ae24d service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:10.655469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.655722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.656464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:35:10.656779 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:10.658383 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:10.668837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1170/2327] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:35:10.681653 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1158/2328] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:35:10.687323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c46eb-ec57-48df-b1eb-6ee6d45ae24d service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.697809 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c46eb-ec57-48df-b1eb-6ee6d45ae24d service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.704056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129a09-7a7b-4608-b1c3-aebac8e38a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.704813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129a09-7a7b-4608-b1c3-aebac8e38a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.705173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129a09-7a7b-4608-b1c3-aebac8e38a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.705523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129a09-7a7b-4608-b1c3-aebac8e38a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.706413 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf129a09-7a7b-4608-b1c3-aebac8e38a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:10.708881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf129a09-7a7b-4608-b1c3-aebac8e38a83 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:10.747504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1171/2329] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:10 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:10.748795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.770135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f41c5-d3c6-4c00-a1dc-83a330dc4a86 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.795771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:10.850936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8af8c4-4dca-447c-b494-06e3d5a2f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.851567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af8c4-4dca-447c-b494-06e3d5a2f4cd admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.853038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af8c4-4dca-447c-b494-06e3d5a2f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.854881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af8c4-4dca-447c-b494-06e3d5a2f4cd admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.856109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8af8c4-4dca-447c-b494-06e3d5a2f4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:10.860809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8af8c4-4dca-447c-b494-06e3d5a2f4cd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:10.892091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129a09-7a7b-4608-b1c3-aebac8e38a83 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.899128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1159/2330] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:10 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:35:10.900335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:10.905923 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129a09-7a7b-4608-b1c3-aebac8e38a83 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.913071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c81cf-6fd9-4600-a905-4513e0812587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.914072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c81cf-6fd9-4600-a905-4513e0812587 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.914371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c81cf-6fd9-4600-a905-4513e0812587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.914874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c81cf-6fd9-4600-a905-4513e0812587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.916480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c81cf-6fd9-4600-a905-4513e0812587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:10.918463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c81cf-6fd9-4600-a905-4513e0812587 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:10.932677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1172/2331] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:10.937337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8af8c4-4dca-447c-b494-06e3d5a2f4cd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.948269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8af8c4-4dca-447c-b494-06e3d5a2f4cd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.954089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.954880 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.955646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.955646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:10.956464 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:10.958201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:10.970312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1160/2332] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:35:10.974563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c81cf-6fd9-4600-a905-4513e0812587 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:10.985528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c81cf-6fd9-4600-a905-4513e0812587 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:10.990709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694d5f1-a8f2-4c77-b8f4-95f32b590036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:10.991637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d5f1-a8f2-4c77-b8f4-95f32b590036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:10.992044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d5f1-a8f2-4c77-b8f4-95f32b590036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:10.992326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d5f1-a8f2-4c77-b8f4-95f32b590036 admin admin] PATH_INFO: `/v3/projects/ee63b16ef3ea460c9fc0f48becea4905/users/bb3535e4807e4f8aa1a864bd4b97c231/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:11.018129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694d5f1-a8f2-4c77-b8f4-95f32b590036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee63b16ef3ea460c9fc0f48becea4905, user_id=bb3535e4807e4f8aa1a864bd4b97c231, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:11.021263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694d5f1-a8f2-4c77-b8f4-95f32b590036 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:11.028765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:11.031414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:11.055084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1173/2333] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:10 2022] PUT /identity/v3/projects/ee63b16ef3ea460c9fc0f48becea4905/users/bb3535e4807e4f8aa1a864bd4b97c231/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:11.067662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708adaa-61f3-4bbd-b010-841885098c9b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:11.072373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802c03f-4305-427b-9fc2-6f710a114d8a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:11.072679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802c03f-4305-427b-9fc2-6f710a114d8a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:11.072968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802c03f-4305-427b-9fc2-6f710a114d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:11.101790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1802c03f-4305-427b-9fc2-6f710a114d8a None None] MFA Rules not processed for user `bb3535e4807e4f8aa1a864bd4b97c231`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:11.103059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1802c03f-4305-427b-9fc2-6f710a114d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:11.152092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:11.153305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:11.153928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:11.154332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] PATH_INFO: `/v3/projects/cc9e18f103844d359c860b48938c33a5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:11.156552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9e18f103844d359c860b48938c33a5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:11.158921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:11.190325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1174/2334] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:11.198951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802c03f-4305-427b-9fc2-6f710a114d8a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:11.201349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1802c03f-4305-427b-9fc2-6f710a114d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:11.239960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9e18f103844d359c860b48938c33a5', 'request_id': 'req-ffb0a881-9916-44eb-923d-e6c351d49dd5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.247533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9e18f103844d359c860b48938c33a5', 'request_id': 'req-ffb0a881-9916-44eb-923d-e6c351d49dd5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.257569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9e18f103844d359c860b48938c33a5', 'request_id': 'req-ffb0a881-9916-44eb-923d-e6c351d49dd5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.275971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] The token cache is being invalidate because project cc9e18f103844d359c860b48938c33a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:11.276361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.277838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.282016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1161/2335] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:11 2022] DELETE /identity/v3/projects/cc9e18f103844d359c860b48938c33a5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:11.283313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802c03f-4305-427b-9fc2-6f710a114d8a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:11.285337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:11.287026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:11.331730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:11.357227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:11.360073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:11.360073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:11.360458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:11.362602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:11.379999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0a881-9916-44eb-923d-e6c351d49dd5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:11.386225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:11.387297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:11.387587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:11.387864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] PATH_INFO: `/v3/users/65476f4fcf7b4478a0af4e21f9c983eb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:11.389101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65476f4fcf7b4478a0af4e21f9c983eb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:11.391705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:11.403896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:11.442307 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:11.443005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65476f4fcf7b4478a0af4e21f9c983eb'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.443760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65476f4fcf7b4478a0af4e21f9c983eb'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.444202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:11.454312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65476f4fcf7b4478a0af4e21f9c983eb'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.458281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1175/2336] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:11.473379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65476f4fcf7b4478a0af4e21f9c983eb'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.486636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7285e1df-7e7e-4fa8-91b9-8cda11a52c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65476f4fcf7b4478a0af4e21f9c983eb'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:11.492901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1162/2337] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:11 2022] DELETE /identity/v3/users/65476f4fcf7b4478a0af4e21f9c983eb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:11.820448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:11.834548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af813-4dd3-4a9d-9748-389beb1ff9aa service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:11.935031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:11.935944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:11.936314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:11.937309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] PATH_INFO: `/v3/projects/e508a0633b3546f8968516672f4b600d` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:11.947008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e508a0633b3546f8968516672f4b600d)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:11.947008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:12.004571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e508a0633b3546f8968516672f4b600d', 'request_id': 'req-298dee1d-798f-4570-8faa-00c5aa1522f6'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:12.010680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e508a0633b3546f8968516672f4b600d', 'request_id': 'req-298dee1d-798f-4570-8faa-00c5aa1522f6'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:12.016993 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e508a0633b3546f8968516672f4b600d', 'request_id': 'req-298dee1d-798f-4570-8faa-00c5aa1522f6'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:12.029676 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] The token cache is being invalidate because project e508a0633b3546f8968516672f4b600d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:12.030141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:12.031315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-298dee1d-798f-4570-8faa-00c5aa1522f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:12.032904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1176/2338] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:11 2022] DELETE /identity/v3/projects/e508a0633b3546f8968516672f4b600d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:12.038416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c87e98-8de7-440f-bf56-a32a4da90cb4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.038632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c87e98-8de7-440f-bf56-a32a4da90cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.038961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c87e98-8de7-440f-bf56-a32a4da90cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.060742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-02c87e98-8de7-440f-bf56-a32a4da90cb4 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:12.062059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-02c87e98-8de7-440f-bf56-a32a4da90cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:12.122077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1163/2339] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:12.129927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150581e0-79a2-4c05-ab5d-1a4a53558008 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.130232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150581e0-79a2-4c05-ab5d-1a4a53558008 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.130534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150581e0-79a2-4c05-ab5d-1a4a53558008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.149101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-150581e0-79a2-4c05-ab5d-1a4a53558008 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:12.150424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-150581e0-79a2-4c05-ab5d-1a4a53558008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:12.160937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1177/2340] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:12.165649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c87e98-8de7-440f-bf56-a32a4da90cb4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:12.176174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c87e98-8de7-440f-bf56-a32a4da90cb4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:12.181881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:12.182581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.182895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.183178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.184187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:35:12.184187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:12.185929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:12.200017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1164/2341] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:35:12.204194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150581e0-79a2-4c05-ab5d-1a4a53558008 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:12.214148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150581e0-79a2-4c05-ab5d-1a4a53558008 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:12.220098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644fca-91c0-41d4-a8e0-d8df912db4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:12.220770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644fca-91c0-41d4-a8e0-d8df912db4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.221055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644fca-91c0-41d4-a8e0-d8df912db4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.221328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644fca-91c0-41d4-a8e0-d8df912db4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.222112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1644fca-91c0-41d4-a8e0-d8df912db4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:12.224132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1644fca-91c0-41d4-a8e0-d8df912db4d0 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:12.253117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1178/2342] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:12 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:12.257204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:12.267571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1781d9-c4d4-4434-8682-70cb095ed2e5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:12.303747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:12.331868 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ab049-36ab-4f44-880e-a62369eca694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:12.332573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab049-36ab-4f44-880e-a62369eca694 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.332854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab049-36ab-4f44-880e-a62369eca694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.333138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab049-36ab-4f44-880e-a62369eca694 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.334410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ab049-36ab-4f44-880e-a62369eca694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:12.335834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ab049-36ab-4f44-880e-a62369eca694 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:12.358253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1165/2343] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:12 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:35:12.362742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644fca-91c0-41d4-a8e0-d8df912db4d0 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:12.373481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644fca-91c0-41d4-a8e0-d8df912db4d0 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:12.378163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921c93f-073a-47b9-b567-f0023cb5118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:12.378865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921c93f-073a-47b9-b567-f0023cb5118b admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.379152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921c93f-073a-47b9-b567-f0023cb5118b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.379448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921c93f-073a-47b9-b567-f0023cb5118b admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.380177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921c93f-073a-47b9-b567-f0023cb5118b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:12.381769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921c93f-073a-47b9-b567-f0023cb5118b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:12.395392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1179/2344] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:35:12.399389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ab049-36ab-4f44-880e-a62369eca694 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:12.410627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ab049-36ab-4f44-880e-a62369eca694 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:12.415332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db82af-32f2-41f0-8b94-1c66f7513ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:12.416046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db82af-32f2-41f0-8b94-1c66f7513ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.416332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db82af-32f2-41f0-8b94-1c66f7513ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.416614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db82af-32f2-41f0-8b94-1c66f7513ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.417889 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db82af-32f2-41f0-8b94-1c66f7513ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:12.419108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db82af-32f2-41f0-8b94-1c66f7513ba6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:12.431618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1166/2345] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:12.435805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921c93f-073a-47b9-b567-f0023cb5118b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:12.446336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921c93f-073a-47b9-b567-f0023cb5118b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:12.451210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:12.452705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.452988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.453278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] PATH_INFO: `/v3/projects/f6e9a222eaf24b878ab685cd4c6dc59f/users/899256ad3ffc427fb0a5f2174d6fc578/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.474490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e9a222eaf24b878ab685cd4c6dc59f, user_id=899256ad3ffc427fb0a5f2174d6fc578, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:12.477395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:12.480288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:12.492817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1180/2346] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:12 2022] PUT /identity/v3/projects/f6e9a222eaf24b878ab685cd4c6dc59f/users/899256ad3ffc427fb0a5f2174d6fc578/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:12.561423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843751-891b-44ea-a4db-560eff6c7f5e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.561636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843751-891b-44ea-a4db-560eff6c7f5e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.561921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843751-891b-44ea-a4db-560eff6c7f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.591316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ce843751-891b-44ea-a4db-560eff6c7f5e None None] MFA Rules not processed for user `899256ad3ffc427fb0a5f2174d6fc578`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:12.592686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ce843751-891b-44ea-a4db-560eff6c7f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:12.666465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1167/2347] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:12.678236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:12.680005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:12.736032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5f10c-c527-4bd8-8bbe-09f29b0cc6a7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:12.739752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf785dbf-2ebb-488d-aa6b-b960938eff7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:12.740403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf785dbf-2ebb-488d-aa6b-b960938eff7a service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:12.740696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf785dbf-2ebb-488d-aa6b-b960938eff7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:12.740979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf785dbf-2ebb-488d-aa6b-b960938eff7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:12.749435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf785dbf-2ebb-488d-aa6b-b960938eff7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:12.750931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf785dbf-2ebb-488d-aa6b-b960938eff7a service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:12.760138 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1181/2348] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:15.382011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843751-891b-44ea-a4db-560eff6c7f5e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:15.446570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843751-891b-44ea-a4db-560eff6c7f5e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:15.451068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:15.451989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:15.452736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:15.453019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] PATH_INFO: `/v3/users/899256ad3ffc427fb0a5f2174d6fc578` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:15.454212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] RBAC: Authorizing `identity:delete_user(user_id=899256ad3ffc427fb0a5f2174d6fc578)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:15.456161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:15.506787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899256ad3ffc427fb0a5f2174d6fc578'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:15.507443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899256ad3ffc427fb0a5f2174d6fc578'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:15.509171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:15.521732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899256ad3ffc427fb0a5f2174d6fc578'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:15.529015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899256ad3ffc427fb0a5f2174d6fc578'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:15.543126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899256ad3ffc427fb0a5f2174d6fc578'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:15.550385 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1168/2349] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:15 2022] DELETE /identity/v3/users/899256ad3ffc427fb0a5f2174d6fc578 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:15.555077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120befae-7b8e-4b11-987d-54a5c2d38fb2 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:15.555933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120befae-7b8e-4b11-987d-54a5c2d38fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:15.556406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120befae-7b8e-4b11-987d-54a5c2d38fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:15.574457 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-120befae-7b8e-4b11-987d-54a5c2d38fb2 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:15.575717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-120befae-7b8e-4b11-987d-54a5c2d38fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:15.648378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1182/2350] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:15.659493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:15.661372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:15.737236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1f411-b656-4a14-adde-63abdc3b099a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:15.745793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab979d3-d642-4ed9-84f1-082f1133e7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:15.745793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab979d3-d642-4ed9-84f1-082f1133e7bb service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:15.745793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab979d3-d642-4ed9-84f1-082f1133e7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:15.745793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab979d3-d642-4ed9-84f1-082f1133e7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:15.755135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab979d3-d642-4ed9-84f1-082f1133e7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:15.756604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab979d3-d642-4ed9-84f1-082f1133e7bb service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:15.768027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1169/2351] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:16.508143 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120befae-7b8e-4b11-987d-54a5c2d38fb2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:16.509934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-120befae-7b8e-4b11-987d-54a5c2d38fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:16.525931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120befae-7b8e-4b11-987d-54a5c2d38fb2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:16.533395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:16.534313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:16.534667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:16.535057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] PATH_INFO: `/v3/projects/f6e9a222eaf24b878ab685cd4c6dc59f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:16.536348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e9a222eaf24b878ab685cd4c6dc59f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:16.538427 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:16.593512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e9a222eaf24b878ab685cd4c6dc59f', 'request_id': 'req-24db12db-6823-4c93-a36c-d89a298002c3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:16.599876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e9a222eaf24b878ab685cd4c6dc59f', 'request_id': 'req-24db12db-6823-4c93-a36c-d89a298002c3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:16.606972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e9a222eaf24b878ab685cd4c6dc59f', 'request_id': 'req-24db12db-6823-4c93-a36c-d89a298002c3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:16.629723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] The token cache is being invalidate because project f6e9a222eaf24b878ab685cd4c6dc59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:16.630249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:16.631161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-24db12db-6823-4c93-a36c-d89a298002c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:16.633111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1183/2352] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:16 2022] DELETE /identity/v3/projects/f6e9a222eaf24b878ab685cd4c6dc59f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:16.638255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f84b-c3ee-463f-84b1-b8c4f2f705cd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:16.638754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f84b-c3ee-463f-84b1-b8c4f2f705cd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:16.639019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f84b-c3ee-463f-84b1-b8c4f2f705cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:16.658644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ceb4f84b-c3ee-463f-84b1-b8c4f2f705cd None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:16.660165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ceb4f84b-c3ee-463f-84b1-b8c4f2f705cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:16.728743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1170/2353] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:16.738286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21519-a749-42c2-9d99-c3d34d519776 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:16.738581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21519-a749-42c2-9d99-c3d34d519776 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:16.738892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21519-a749-42c2-9d99-c3d34d519776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:16.757433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d0a21519-a749-42c2-9d99-c3d34d519776 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:16.758573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d0a21519-a749-42c2-9d99-c3d34d519776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:16.767071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1184/2354] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:16.771389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f84b-c3ee-463f-84b1-b8c4f2f705cd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:16.781239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f84b-c3ee-463f-84b1-b8c4f2f705cd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:16.786261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:16.786961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:16.787255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:16.787969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:16.788272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:35:16.788619 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:16.790578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:16.803507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1171/2355] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:35:16.807903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a21519-a749-42c2-9d99-c3d34d519776 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:16.821567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a21519-a749-42c2-9d99-c3d34d519776 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:16.826484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b31b-0f80-4486-909f-bffe1566f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:16.827739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b31b-0f80-4486-909f-bffe1566f00b admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:16.828026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b31b-0f80-4486-909f-bffe1566f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:16.828304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b31b-0f80-4486-909f-bffe1566f00b admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:16.829004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b31b-0f80-4486-909f-bffe1566f00b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:16.830939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b31b-0f80-4486-909f-bffe1566f00b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:16.841498 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:16.862483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1185/2356] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:16 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:16.866577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:16.877696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a50b-db09-4d1c-ad44-6fc32525f699 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:16.930108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:16.940566 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f285d6-f4e9-414b-8d58-a1c82f86e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:16.941250 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f285d6-f4e9-414b-8d58-a1c82f86e1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:16.941551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f285d6-f4e9-414b-8d58-a1c82f86e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:16.941823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f285d6-f4e9-414b-8d58-a1c82f86e1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:16.942529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f285d6-f4e9-414b-8d58-a1c82f86e1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:16.944491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f285d6-f4e9-414b-8d58-a1c82f86e1f8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:16.966450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1172/2357] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:16 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:35:16.970100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b31b-0f80-4486-909f-bffe1566f00b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:16.982527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b31b-0f80-4486-909f-bffe1566f00b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:16.988273 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40045cbf-1ef6-4fe0-9dc6-f295081794f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:16.988942 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045cbf-1ef6-4fe0-9dc6-f295081794f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:16.989230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045cbf-1ef6-4fe0-9dc6-f295081794f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:16.989509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045cbf-1ef6-4fe0-9dc6-f295081794f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:16.990245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40045cbf-1ef6-4fe0-9dc6-f295081794f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:16.991901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40045cbf-1ef6-4fe0-9dc6-f295081794f1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:17.004346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1186/2358] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:17.008288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f285d6-f4e9-414b-8d58-a1c82f86e1f8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:17.025399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f285d6-f4e9-414b-8d58-a1c82f86e1f8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:17.030838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111f612-3adf-409c-9a78-247bf2f5d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:17.031600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f612-3adf-409c-9a78-247bf2f5d33c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.031986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f612-3adf-409c-9a78-247bf2f5d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.032336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111f612-3adf-409c-9a78-247bf2f5d33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.033370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111f612-3adf-409c-9a78-247bf2f5d33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:17.035089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111f612-3adf-409c-9a78-247bf2f5d33c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:17.052563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1173/2359] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:17.056988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40045cbf-1ef6-4fe0-9dc6-f295081794f1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:17.080597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40045cbf-1ef6-4fe0-9dc6-f295081794f1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:17.085270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:17.086163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.086450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.086722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] PATH_INFO: `/v3/projects/f7c941cbc8474649beef4a3da8e6560c/users/db2f2e0ad8a14b5f8e0d9a249e4ebc9b/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.103579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c941cbc8474649beef4a3da8e6560c, user_id=db2f2e0ad8a14b5f8e0d9a249e4ebc9b, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:17.106214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:17.121421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1187/2360] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:17 2022] PUT /identity/v3/projects/f7c941cbc8474649beef4a3da8e6560c/users/db2f2e0ad8a14b5f8e0d9a249e4ebc9b/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:17.135296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f069881-390e-4d92-b960-af1b2db9e232 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.135597 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f069881-390e-4d92-b960-af1b2db9e232 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.135884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f069881-390e-4d92-b960-af1b2db9e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.163374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4f069881-390e-4d92-b960-af1b2db9e232 None None] MFA Rules not processed for user `db2f2e0ad8a14b5f8e0d9a249e4ebc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:17.164603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4f069881-390e-4d92-b960-af1b2db9e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:17.238718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1174/2361] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:17.275670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:17.278914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:17.342538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69ead2-8ec3-44b9-b486-94bc14908c5e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:17.346689 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe4b24-b4ce-47c9-acc2-829ee8b96361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:17.347377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe4b24-b4ce-47c9-acc2-829ee8b96361 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.347664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe4b24-b4ce-47c9-acc2-829ee8b96361 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.347939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe4b24-b4ce-47c9-acc2-829ee8b96361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.356581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe4b24-b4ce-47c9-acc2-829ee8b96361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:17.358024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe4b24-b4ce-47c9-acc2-829ee8b96361 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:17.367698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1188/2362] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:19.927989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de40d6-2776-4da6-90aa-4ab4be9401e6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:19.928746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de40d6-2776-4da6-90aa-4ab4be9401e6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:19.928746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de40d6-2776-4da6-90aa-4ab4be9401e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:19.950106 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-31de40d6-2776-4da6-90aa-4ab4be9401e6 None None] MFA Rules not processed for user `3522c9dae7854c2395b6a00a9094b10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:19.951930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-31de40d6-2776-4da6-90aa-4ab4be9401e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:20.023281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1175/2363] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:22.770086 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe4b24-b4ce-47c9-acc2-829ee8b96361 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:22.831783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe4b24-b4ce-47c9-acc2-829ee8b96361 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:22.836200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:22.837073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:22.837359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:22.837639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] PATH_INFO: `/v3/users/db2f2e0ad8a14b5f8e0d9a249e4ebc9b` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:22.838853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2f2e0ad8a14b5f8e0d9a249e4ebc9b)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:22.840795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:22.885754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2f2e0ad8a14b5f8e0d9a249e4ebc9b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:22.896238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:22.898373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2f2e0ad8a14b5f8e0d9a249e4ebc9b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:22.899132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2f2e0ad8a14b5f8e0d9a249e4ebc9b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:22.908268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2f2e0ad8a14b5f8e0d9a249e4ebc9b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:22.916673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2f2e0ad8a14b5f8e0d9a249e4ebc9b'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:22.924699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1189/2364] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:22 2022] DELETE /identity/v3/users/db2f2e0ad8a14b5f8e0d9a249e4ebc9b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:22.929393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b6a5-8399-427a-950e-7b3da47ef8cf None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:22.929957 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b6a5-8399-427a-950e-7b3da47ef8cf None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:22.930067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089b6a5-8399-427a-950e-7b3da47ef8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:22.959440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c089b6a5-8399-427a-950e-7b3da47ef8cf None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:22.960664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c089b6a5-8399-427a-950e-7b3da47ef8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:23.049500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1176/2365] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:23.067077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:23.070055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:23.196778 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aa69d-b01f-4f4b-a6c4-4afdd7c56be3 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:23.201370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:23.202228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:23.202730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:23.203173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:23.215576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:23.217287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:23.230188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1190/2366] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:23.734280 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089b6a5-8399-427a-950e-7b3da47ef8cf None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:23.739118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c089b6a5-8399-427a-950e-7b3da47ef8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:23.753285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089b6a5-8399-427a-950e-7b3da47ef8cf None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:23.759350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:23.760482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:23.760600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:23.761006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] PATH_INFO: `/v3/projects/f7c941cbc8474649beef4a3da8e6560c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:23.762297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c941cbc8474649beef4a3da8e6560c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:23.764351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:23.770248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:23.796410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:23.797832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:23.814385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ece4a6-a37e-481c-9447-45a5afaeecc2 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:23.821067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:23.822245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:23.822430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:23.822733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] PATH_INFO: `/v3/users/bb3535e4807e4f8aa1a864bd4b97c231` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:23.824260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3535e4807e4f8aa1a864bd4b97c231)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:23.826123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:23.841338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c941cbc8474649beef4a3da8e6560c', 'request_id': 'req-5b45a12c-da71-4d8c-84ae-bda013fc853d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.849832 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c941cbc8474649beef4a3da8e6560c', 'request_id': 'req-5b45a12c-da71-4d8c-84ae-bda013fc853d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.860544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c941cbc8474649beef4a3da8e6560c', 'request_id': 'req-5b45a12c-da71-4d8c-84ae-bda013fc853d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.876409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] The token cache is being invalidate because project f7c941cbc8474649beef4a3da8e6560c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:23.876986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.877877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5b45a12c-da71-4d8c-84ae-bda013fc853d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.880021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1177/2367] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:23 2022] DELETE /identity/v3/projects/f7c941cbc8474649beef4a3da8e6560c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:23.887066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3535e4807e4f8aa1a864bd4b97c231'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.902873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3535e4807e4f8aa1a864bd4b97c231'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.903692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3535e4807e4f8aa1a864bd4b97c231'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.918232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3535e4807e4f8aa1a864bd4b97c231'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.929434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3535e4807e4f8aa1a864bd4b97c231'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:23.942198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1191/2368] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:23 2022] DELETE /identity/v3/users/bb3535e4807e4f8aa1a864bd4b97c231 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:23.945313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863709a-ecec-4af5-95d3-113912825baf None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:23.946746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863709a-ecec-4af5-95d3-113912825baf None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:23.947238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863709a-ecec-4af5-95d3-113912825baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:23.968681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d863709a-ecec-4af5-95d3-113912825baf None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:23.970150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d863709a-ecec-4af5-95d3-113912825baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:24.069583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1178/2369] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:24.079757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:24.081432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:24.145152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1123e9-1371-4cc4-aeea-1bd8c81e91d1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:24.148694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3be4b-b46a-40aa-af0c-909243f1ef5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:24.149355 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3be4b-b46a-40aa-af0c-909243f1ef5a service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:24.149642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3be4b-b46a-40aa-af0c-909243f1ef5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:24.149919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3be4b-b46a-40aa-af0c-909243f1ef5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:24.157432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:24.160401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3be4b-b46a-40aa-af0c-909243f1ef5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:24.163754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3be4b-b46a-40aa-af0c-909243f1ef5a service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:24.175258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1192/2370] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:35:24.652090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863709a-ecec-4af5-95d3-113912825baf None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:24.654461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d863709a-ecec-4af5-95d3-113912825baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:24.670444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863709a-ecec-4af5-95d3-113912825baf None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:24.675427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:24.676312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:24.676608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:24.676895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] PATH_INFO: `/v3/projects/ee63b16ef3ea460c9fc0f48becea4905` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:24.679182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee63b16ef3ea460c9fc0f48becea4905)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:24.681134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:24.753027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee63b16ef3ea460c9fc0f48becea4905', 'request_id': 'req-4725e422-b706-4a09-bc81-cb4c4215e6ca'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:24.760210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee63b16ef3ea460c9fc0f48becea4905', 'request_id': 'req-4725e422-b706-4a09-bc81-cb4c4215e6ca'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:24.768328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee63b16ef3ea460c9fc0f48becea4905', 'request_id': 'req-4725e422-b706-4a09-bc81-cb4c4215e6ca'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:24.787079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] The token cache is being invalidate because project ee63b16ef3ea460c9fc0f48becea4905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:24.787688 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:24.788836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4725e422-b706-4a09-bc81-cb4c4215e6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:24.790783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1179/2371] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:24 2022] DELETE /identity/v3/projects/ee63b16ef3ea460c9fc0f48becea4905 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:25.066501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c148-9d77-4f61-9ab6-5443ded2a824 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:25.067053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c148-9d77-4f61-9ab6-5443ded2a824 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:25.067237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c148-9d77-4f61-9ab6-5443ded2a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:25.089269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ed29c148-9d77-4f61-9ab6-5443ded2a824 None None] MFA Rules not processed for user `27cbfa54860940bc84e576943c0b9503`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:25.090798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ed29c148-9d77-4f61-9ab6-5443ded2a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:25.157849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1193/2372] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:30.684231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27950d-ce1c-43e2-b8dc-be867a331d08 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:30.684696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27950d-ce1c-43e2-b8dc-be867a331d08 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:30.684866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27950d-ce1c-43e2-b8dc-be867a331d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:30.705271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0a27950d-ce1c-43e2-b8dc-be867a331d08 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:30.706524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0a27950d-ce1c-43e2-b8dc-be867a331d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:30.716821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:30.768076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1180/2373] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:35:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:30.783152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29c148-9d77-4f61-9ab6-5443ded2a824 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:30.784854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ed29c148-9d77-4f61-9ab6-5443ded2a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:30.853495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29c148-9d77-4f61-9ab6-5443ded2a824 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:30.858662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582f368-88d3-41c2-9cce-5d6b0d6fb583 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:30.859424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f368-88d3-41c2-9cce-5d6b0d6fb583 service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:30.859716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f368-88d3-41c2-9cce-5d6b0d6fb583 service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:30.860001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f368-88d3-41c2-9cce-5d6b0d6fb583 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:30.868630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582f368-88d3-41c2-9cce-5d6b0d6fb583 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:30.871959 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582f368-88d3-41c2-9cce-5d6b0d6fb583 service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:30.880946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1194/2374] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:35:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:35:35.930985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5e4c3-e795-4899-a529-6acef23a4e6e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:35.931565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5e4c3-e795-4899-a529-6acef23a4e6e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:35.931565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5e4c3-e795-4899-a529-6acef23a4e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:35.951724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cfb5e4c3-e795-4899-a529-6acef23a4e6e None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:35.954545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cfb5e4c3-e795-4899-a529-6acef23a4e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:35.966932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1181/2375] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:35:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:35.976189 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582f368-88d3-41c2-9cce-5d6b0d6fb583 service swift] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:35.987195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582f368-88d3-41c2-9cce-5d6b0d6fb583 service swift] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:35.992527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e4a38-9bce-4fe4-9e5e-be0a3b224749 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:35.993249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4a38-9bce-4fe4-9e5e-be0a3b224749 service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:35.993542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4a38-9bce-4fe4-9e5e-be0a3b224749 service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:35.993826 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4a38-9bce-4fe4-9e5e-be0a3b224749 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:36.002144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e4a38-9bce-4fe4-9e5e-be0a3b224749 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:36.003770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e4a38-9bce-4fe4-9e5e-be0a3b224749 service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:36.012337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1195/2376] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:35:45.946373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=21 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:46.009041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=65 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:52.892331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff50b6-7fd4-4b69-b593-2fb1faa13aa9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:52.892946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff50b6-7fd4-4b69-b593-2fb1faa13aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:52.892946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff50b6-7fd4-4b69-b593-2fb1faa13aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:52.912233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0bff50b6-7fd4-4b69-b593-2fb1faa13aa9 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:52.913810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0bff50b6-7fd4-4b69-b593-2fb1faa13aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:52.928261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1182/2377] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jul 12 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:52.937446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e4a38-9bce-4fe4-9e5e-be0a3b224749 service swift] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:52.950579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e4a38-9bce-4fe4-9e5e-be0a3b224749 service swift] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:52.957595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bd523-f71c-4062-aa72-596e2edaf0ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:52.958444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd523-f71c-4062-aa72-596e2edaf0ec service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:52.958803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd523-f71c-4062-aa72-596e2edaf0ec service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:52.959227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd523-f71c-4062-aa72-596e2edaf0ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:52.969041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bd523-f71c-4062-aa72-596e2edaf0ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:52.970665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bd523-f71c-4062-aa72-596e2edaf0ec service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:52.981757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1196/2378] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:35:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:35:53.362883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0704bf-7327-48e5-a0e3-0ded88bf18e8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.363366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0704bf-7327-48e5-a0e3-0ded88bf18e8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.363993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0704bf-7327-48e5-a0e3-0ded88bf18e8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.365394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1183/2379] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:53.374055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814a15-6bcb-4811-8463-a9f193062b7e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.374392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814a15-6bcb-4811-8463-a9f193062b7e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.374994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814a15-6bcb-4811-8463-a9f193062b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.402103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-40814a15-6bcb-4811-8463-a9f193062b7e None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:53.403866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-40814a15-6bcb-4811-8463-a9f193062b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:53.486048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1197/2380] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:53.498537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0704bf-7327-48e5-a0e3-0ded88bf18e8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:53.500888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8c0704bf-7327-48e5-a0e3-0ded88bf18e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:53.559984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0704bf-7327-48e5-a0e3-0ded88bf18e8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:53.564146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14829f37-8b55-497b-9863-608f3cedceed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a81dce4c3ffd42bd85bf6e7687b5cbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:53.564794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14829f37-8b55-497b-9863-608f3cedceed service glance] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.565079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14829f37-8b55-497b-9863-608f3cedceed service glance] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.565357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14829f37-8b55-497b-9863-608f3cedceed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.575414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14829f37-8b55-497b-9863-608f3cedceed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:53.577501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14829f37-8b55-497b-9863-608f3cedceed service glance] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:53.588176 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1184/2381] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:53.654481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283c85-5ce8-4c62-b8d3-63f9c4d943d6 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.654815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283c85-5ce8-4c62-b8d3-63f9c4d943d6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.655092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283c85-5ce8-4c62-b8d3-63f9c4d943d6 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.656533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1198/2382] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:53.661549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e4b-89e6-4185-9c71-46ebb0bea4fc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.661842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e4b-89e6-4185-9c71-46ebb0bea4fc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.662128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e4b-89e6-4185-9c71-46ebb0bea4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.681804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fc962e4b-89e6-4185-9c71-46ebb0bea4fc None None] MFA Rules not processed for user `18d55b1fd69640548e7b35258e33e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:53.683292 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fc962e4b-89e6-4185-9c71-46ebb0bea4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:53.736454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1185/2383] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:53.749300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4283c85-5ce8-4c62-b8d3-63f9c4d943d6 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:53.751053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a4283c85-5ce8-4c62-b8d3-63f9c4d943d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:53.763996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4283c85-5ce8-4c62-b8d3-63f9c4d943d6 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:53.767596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad630b-da83-4f68-bcfe-3a24bc906911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:53.768233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad630b-da83-4f68-bcfe-3a24bc906911 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.768520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad630b-da83-4f68-bcfe-3a24bc906911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.768801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad630b-da83-4f68-bcfe-3a24bc906911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.775816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad630b-da83-4f68-bcfe-3a24bc906911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:53.777255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad630b-da83-4f68-bcfe-3a24bc906911 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:53.785208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1199/2384] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:53.876495 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b46da-d46d-4ecb-8688-7761304f1f59 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.876817 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b46da-d46d-4ecb-8688-7761304f1f59 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.877099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b46da-d46d-4ecb-8688-7761304f1f59 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.878508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1186/2385] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:53.883411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414dee8-38e0-4f05-9f4f-0d11483bd62e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.883710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414dee8-38e0-4f05-9f4f-0d11483bd62e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.883991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414dee8-38e0-4f05-9f4f-0d11483bd62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.901897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7414dee8-38e0-4f05-9f4f-0d11483bd62e None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:53.903149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7414dee8-38e0-4f05-9f4f-0d11483bd62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:53.913904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1200/2386] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:53.925337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b46da-d46d-4ecb-8688-7761304f1f59 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:53.927486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-782b46da-d46d-4ecb-8688-7761304f1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:53.942939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b46da-d46d-4ecb-8688-7761304f1f59 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:53.946898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9a6e1-ff06-4ca3-9c09-9dc0bb6351b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:53.947548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a6e1-ff06-4ca3-9c09-9dc0bb6351b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:53.947838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a6e1-ff06-4ca3-9c09-9dc0bb6351b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:53.948127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9a6e1-ff06-4ca3-9c09-9dc0bb6351b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:53.958162 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9a6e1-ff06-4ca3-9c09-9dc0bb6351b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:53.959641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9a6e1-ff06-4ca3-9c09-9dc0bb6351b1 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:53.972008 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1187/2387] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:55.037611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414dee8-38e0-4f05-9f4f-0d11483bd62e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:55.041545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7414dee8-38e0-4f05-9f4f-0d11483bd62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:55.111174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414dee8-38e0-4f05-9f4f-0d11483bd62e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:55.115994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:55.116881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:55.117168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:55.117447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] PATH_INFO: `/v3/users/195821093293441abe4768162a6fe5a7` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:55.118634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195821093293441abe4768162a6fe5a7)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:55.120814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:55.169967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195821093293441abe4768162a6fe5a7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.181163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:55.183667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195821093293441abe4768162a6fe5a7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.184651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195821093293441abe4768162a6fe5a7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.193317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195821093293441abe4768162a6fe5a7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.200402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-c413b7ad-fee8-409b-8018-72d9096f6ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195821093293441abe4768162a6fe5a7'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.206326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1201/2388] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:55 2022] DELETE /identity/v3/users/195821093293441abe4768162a6fe5a7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:55.381439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9a6e1-ff06-4ca3-9c09-9dc0bb6351b1 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:55.392414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9a6e1-ff06-4ca3-9c09-9dc0bb6351b1 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:55.449295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:55.450138 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:55.450462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:55.450737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] PATH_INFO: `/v3/projects/83603121771e4923b4de06f24a6400c0` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:55.452084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83603121771e4923b4de06f24a6400c0)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:55.453993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:55.489701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:55.500509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83603121771e4923b4de06f24a6400c0', 'request_id': 'req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.506461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83603121771e4923b4de06f24a6400c0', 'request_id': 'req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.511897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83603121771e4923b4de06f24a6400c0', 'request_id': 'req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.523930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] The token cache is being invalidate because project 83603121771e4923b4de06f24a6400c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:55.524222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.524839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:55.526366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1188/2389] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:55 2022] DELETE /identity/v3/projects/83603121771e4923b4de06f24a6400c0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:56.628694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bf46-d5ea-44f3-83a2-e4a2d791fa0e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:56.629180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bf46-d5ea-44f3-83a2-e4a2d791fa0e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:56.629268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bf46-d5ea-44f3-83a2-e4a2d791fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:56.647153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-99f8bf46-d5ea-44f3-83a2-e4a2d791fa0e None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:56.648340 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-99f8bf46-d5ea-44f3-83a2-e4a2d791fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:56.702532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1202/2390] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:35:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:56.714095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:56.715626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:56.732721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8bf46-d5ea-44f3-83a2-e4a2d791fa0e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:56.734634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-99f8bf46-d5ea-44f3-83a2-e4a2d791fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:56.786949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0b7be-6fff-4b63-a9e8-991a4221ea5c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:56.791906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc84ab-1d4d-4ad7-a93c-927d859117e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:56.792561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc84ab-1d4d-4ad7-a93c-927d859117e1 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:56.792849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc84ab-1d4d-4ad7-a93c-927d859117e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:56.793130 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc84ab-1d4d-4ad7-a93c-927d859117e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:56.803300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc84ab-1d4d-4ad7-a93c-927d859117e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:56.804888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc84ab-1d4d-4ad7-a93c-927d859117e1 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:56.805529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8bf46-d5ea-44f3-83a2-e4a2d791fa0e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:56.810681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:56.812181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:56.812468 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:56.812754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] PATH_INFO: `/v3/users/c164fd40f2a14b428eda1e74153e2fad` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:56.813964 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c164fd40f2a14b428eda1e74153e2fad)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:56.814547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1189/2391] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:35:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:35:56.816225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:56.881733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c164fd40f2a14b428eda1e74153e2fad'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:56.908305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c164fd40f2a14b428eda1e74153e2fad'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:56.909731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c164fd40f2a14b428eda1e74153e2fad'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:56.923395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c164fd40f2a14b428eda1e74153e2fad'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:56.937142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c164fd40f2a14b428eda1e74153e2fad'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:56.947806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1203/2392] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:35:56 2022] DELETE /identity/v3/users/c164fd40f2a14b428eda1e74153e2fad => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:56.953736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db000ea9-55d8-4022-a6ee-c44625468e42 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:56.954433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db000ea9-55d8-4022-a6ee-c44625468e42 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:56.954854 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db000ea9-55d8-4022-a6ee-c44625468e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:56.998347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-db000ea9-55d8-4022-a6ee-c44625468e42 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:57.001820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-db000ea9-55d8-4022-a6ee-c44625468e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:57.124900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1190/2393] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:57.136121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:57.137691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:57.145488 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:57.242305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9250e-1a8c-4bbe-81bd-3facede31987 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:57.246174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5018dd-427c-440c-a2e9-b049d61c4b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:57.246846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5018dd-427c-440c-a2e9-b049d61c4b6b service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:57.247496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5018dd-427c-440c-a2e9-b049d61c4b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:57.247496 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5018dd-427c-440c-a2e9-b049d61c4b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:57.258743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5018dd-427c-440c-a2e9-b049d61c4b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:57.260338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5018dd-427c-440c-a2e9-b049d61c4b6b service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:57.282566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1204/2394] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:57.568898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db000ea9-55d8-4022-a6ee-c44625468e42 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:57.570346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-db000ea9-55d8-4022-a6ee-c44625468e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:57.582659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db000ea9-55d8-4022-a6ee-c44625468e42 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:57.588617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:57.589751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:57.590040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:57.597507 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] PATH_INFO: `/v3/projects/2332fd905cb54681a13f3197f86cc09b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:57.598819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2332fd905cb54681a13f3197f86cc09b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:57.600781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:57.660525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:57.662148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2332fd905cb54681a13f3197f86cc09b', 'request_id': 'req-49d5e393-4deb-40e3-90e9-8a735366b5a5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:57.671030 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2332fd905cb54681a13f3197f86cc09b', 'request_id': 'req-49d5e393-4deb-40e3-90e9-8a735366b5a5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:57.677172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2332fd905cb54681a13f3197f86cc09b', 'request_id': 'req-49d5e393-4deb-40e3-90e9-8a735366b5a5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:57.692752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] The token cache is being invalidate because project 2332fd905cb54681a13f3197f86cc09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:35:57.693199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:57.693862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-49d5e393-4deb-40e3-90e9-8a735366b5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:35:57.696050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1191/2395] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:35:57 2022] DELETE /identity/v3/projects/2332fd905cb54681a13f3197f86cc09b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:35:57.701290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d431-c91c-4d6f-903b-cd6594b3746a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:57.701882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d431-c91c-4d6f-903b-cd6594b3746a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:57.702267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d431-c91c-4d6f-903b-cd6594b3746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:57.721317 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a8f6d431-c91c-4d6f-903b-cd6594b3746a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:57.722541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a8f6d431-c91c-4d6f-903b-cd6594b3746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:57.789084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1205/2396] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:35:57.797701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15884482-f40c-4e67-abbb-269fcd7e15b0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:57.798297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15884482-f40c-4e67-abbb-269fcd7e15b0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:57.798411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15884482-f40c-4e67-abbb-269fcd7e15b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:57.819580 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-15884482-f40c-4e67-abbb-269fcd7e15b0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:57.821217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-15884482-f40c-4e67-abbb-269fcd7e15b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:57.832829 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1192/2397] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:57.837180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6d431-c91c-4d6f-903b-cd6594b3746a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:57.847237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6d431-c91c-4d6f-903b-cd6594b3746a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:57.851842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:57.852724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:57.853035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:57.853310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:57.854176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:35:57.854642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:57.856432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:57.869453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1206/2398] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:35:57.874230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15884482-f40c-4e67-abbb-269fcd7e15b0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:57.886552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15884482-f40c-4e67-abbb-269fcd7e15b0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:57.895413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b5229-dd18-4f5a-8236-eff3feb5f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:57.896117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5229-dd18-4f5a-8236-eff3feb5f56a admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:57.896410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5229-dd18-4f5a-8236-eff3feb5f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:57.896692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5229-dd18-4f5a-8236-eff3feb5f56a admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:57.897404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b5229-dd18-4f5a-8236-eff3feb5f56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:57.899370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b5229-dd18-4f5a-8236-eff3feb5f56a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:57.926283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1193/2399] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:35:57 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:57.930447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:57.942342 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c375ac-8cf0-48ad-9155-6aca196c9e45 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:58.012583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e26f13-1a81-42c3-b40f-5f29c57481ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:58.012800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e26f13-1a81-42c3-b40f-5f29c57481ce admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:58.013089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e26f13-1a81-42c3-b40f-5f29c57481ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:58.013373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e26f13-1a81-42c3-b40f-5f29c57481ce admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:58.014081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e26f13-1a81-42c3-b40f-5f29c57481ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:58.017082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e26f13-1a81-42c3-b40f-5f29c57481ce admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:58.039889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1207/2400] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:35:57 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:35:58.043739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b5229-dd18-4f5a-8236-eff3feb5f56a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:58.054913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b5229-dd18-4f5a-8236-eff3feb5f56a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:58.060295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9fd86-1b86-4329-a3da-343a8b0328cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:58.060981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9fd86-1b86-4329-a3da-343a8b0328cf admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:58.061786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9fd86-1b86-4329-a3da-343a8b0328cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:58.062065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9fd86-1b86-4329-a3da-343a8b0328cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:58.062819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9fd86-1b86-4329-a3da-343a8b0328cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:58.064466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9fd86-1b86-4329-a3da-343a8b0328cf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:58.075696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1194/2401] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:58.080258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e26f13-1a81-42c3-b40f-5f29c57481ce admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:58.090986 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e26f13-1a81-42c3-b40f-5f29c57481ce admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:58.096279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388885e-0796-4b11-8a1b-efe8b1b9e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:58.097077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388885e-0796-4b11-8a1b-efe8b1b9e14c admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:58.097371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388885e-0796-4b11-8a1b-efe8b1b9e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:58.097656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388885e-0796-4b11-8a1b-efe8b1b9e14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:58.098389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388885e-0796-4b11-8a1b-efe8b1b9e14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:58.100047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388885e-0796-4b11-8a1b-efe8b1b9e14c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:58.111929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1208/2402] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:58.116874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9fd86-1b86-4329-a3da-343a8b0328cf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:58.129144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9fd86-1b86-4329-a3da-343a8b0328cf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:58.134905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:58.136022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:58.136459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:58.137056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] PATH_INFO: `/v3/projects/c49a99c10f5145f4a73ce1664e23fdb0/users/40ea9ac94d1d4569a2c4620ea18826d1/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:58.156354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49a99c10f5145f4a73ce1664e23fdb0, user_id=40ea9ac94d1d4569a2c4620ea18826d1, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:58.159896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:58.176050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1195/2403] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:35:58 2022] PUT /identity/v3/projects/c49a99c10f5145f4a73ce1664e23fdb0/users/40ea9ac94d1d4569a2c4620ea18826d1/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:35:58.181229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0231-b551-4ab7-af41-42948829f887 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:58.181473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0231-b551-4ab7-af41-42948829f887 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:58.181745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0231-b551-4ab7-af41-42948829f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:58.200584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a04d0231-b551-4ab7-af41-42948829f887 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:58.201844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a04d0231-b551-4ab7-af41-42948829f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:58.207102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:58.270058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1209/2404] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:58.279867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:58.281999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:58.368522 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bb58-fc35-49c1-af87-35d9e8a07434 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:58.388146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af408f-ca1d-494c-af88-1db25325c6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:58.389035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af408f-ca1d-494c-af88-1db25325c6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:58.389432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af408f-ca1d-494c-af88-1db25325c6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:58.390390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af408f-ca1d-494c-af88-1db25325c6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:58.401073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af408f-ca1d-494c-af88-1db25325c6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:58.402884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af408f-ca1d-494c-af88-1db25325c6d7 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:58.416461 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1196/2405] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:36:03.857603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121119eb-a7be-40bc-89ae-b0bb95ecb420 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:03.858693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121119eb-a7be-40bc-89ae-b0bb95ecb420 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:03.858890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121119eb-a7be-40bc-89ae-b0bb95ecb420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:03.909304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-121119eb-a7be-40bc-89ae-b0bb95ecb420 None None] MFA Rules not processed for user `40ea9ac94d1d4569a2c4620ea18826d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:36:03.910996 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-121119eb-a7be-40bc-89ae-b0bb95ecb420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:04.013372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1210/2406] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:36:04.018568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af408f-ca1d-494c-af88-1db25325c6d7 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:04.031489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af408f-ca1d-494c-af88-1db25325c6d7 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:04.039574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c456-5d17-4e16-9b46-5137a1d26532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:04.040353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c456-5d17-4e16-9b46-5137a1d26532 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:04.040646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c456-5d17-4e16-9b46-5137a1d26532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:04.041023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c456-5d17-4e16-9b46-5137a1d26532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:04.041796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278c456-5d17-4e16-9b46-5137a1d26532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:04.043947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278c456-5d17-4e16-9b46-5137a1d26532 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:04.087172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1197/2407] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:36:04 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:36:04.097767 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121119eb-a7be-40bc-89ae-b0bb95ecb420 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:04.115580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121119eb-a7be-40bc-89ae-b0bb95ecb420 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:04.232193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14943-5c8f-4f4c-8061-935cb420415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:04.233648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14943-5c8f-4f4c-8061-935cb420415b admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:04.233935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14943-5c8f-4f4c-8061-935cb420415b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:04.234220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14943-5c8f-4f4c-8061-935cb420415b admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:04.235024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f14943-5c8f-4f4c-8061-935cb420415b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:04.237672 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f14943-5c8f-4f4c-8061-935cb420415b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:04.263432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1211/2408] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:36:04 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:36:04.264676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c456-5d17-4e16-9b46-5137a1d26532 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:04.284695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c456-5d17-4e16-9b46-5137a1d26532 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:04.290939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ab072-4b0a-4c6c-afbc-320b4e2f3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:04.291880 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ab072-4b0a-4c6c-afbc-320b4e2f3fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:04.292346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ab072-4b0a-4c6c-afbc-320b4e2f3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:04.292793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ab072-4b0a-4c6c-afbc-320b4e2f3fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:04.293717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ab072-4b0a-4c6c-afbc-320b4e2f3fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:04.296020 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ab072-4b0a-4c6c-afbc-320b4e2f3fc7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:04.308377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1198/2409] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:36:04.313020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14943-5c8f-4f4c-8061-935cb420415b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:04.330339 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14943-5c8f-4f4c-8061-935cb420415b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:04.336643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfba3-db71-4949-a923-fc9f2e77726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:04.338132 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfba3-db71-4949-a923-fc9f2e77726b admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:04.338655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfba3-db71-4949-a923-fc9f2e77726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:04.339303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfba3-db71-4949-a923-fc9f2e77726b admin admin] PATH_INFO: `/v3/projects/4326c99d9bda40cabbc0a17e9b97a1f2/users/e3cf9d4cc3a84750827e191b21d8d229/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:04.361603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbfba3-db71-4949-a923-fc9f2e77726b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4326c99d9bda40cabbc0a17e9b97a1f2, user_id=e3cf9d4cc3a84750827e191b21d8d229, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:04.364607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbfba3-db71-4949-a923-fc9f2e77726b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:04.391502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1212/2410] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:36:04 2022] PUT /identity/v3/projects/4326c99d9bda40cabbc0a17e9b97a1f2/users/e3cf9d4cc3a84750827e191b21d8d229/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:36:04.395539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ab072-4b0a-4c6c-afbc-320b4e2f3fc7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:04.406132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ab072-4b0a-4c6c-afbc-320b4e2f3fc7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:04.473617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:04.504120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af7052-d007-4e29-8e11-05fd86ee1f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:04.504981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af7052-d007-4e29-8e11-05fd86ee1f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:04.505497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af7052-d007-4e29-8e11-05fd86ee1f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:04.506067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af7052-d007-4e29-8e11-05fd86ee1f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:04.507393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af7052-d007-4e29-8e11-05fd86ee1f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:04.509151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af7052-d007-4e29-8e11-05fd86ee1f84 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:04.522027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1199/2411] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:36:04.526669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfba3-db71-4949-a923-fc9f2e77726b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:04.543651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfba3-db71-4949-a923-fc9f2e77726b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:04.549354 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:04.550314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:04.550599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:04.550915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] PATH_INFO: `/v3/projects/4326c99d9bda40cabbc0a17e9b97a1f2/users/e3cf9d4cc3a84750827e191b21d8d229/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:04.553058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4326c99d9bda40cabbc0a17e9b97a1f2, user_id=e3cf9d4cc3a84750827e191b21d8d229, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:04.556036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:04.558597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:04.573449 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1213/2412] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:36:04 2022] PUT /identity/v3/projects/4326c99d9bda40cabbc0a17e9b97a1f2/users/e3cf9d4cc3a84750827e191b21d8d229/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:36:09.395909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfdbcc-5891-4db7-a445-0853eff75924 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:09.396456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfdbcc-5891-4db7-a445-0853eff75924 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:09.396632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfdbcc-5891-4db7-a445-0853eff75924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:09.423634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-61bfdbcc-5891-4db7-a445-0853eff75924 None None] MFA Rules not processed for user `e3cf9d4cc3a84750827e191b21d8d229`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:36:09.424963 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-61bfdbcc-5891-4db7-a445-0853eff75924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:09.495689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1200/2413] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:36:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:36:09.509216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:09.510998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:09.590072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cbb47-813b-4ae9-ba25-5e0c7f7418fb admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:09.596264 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf060-b8e3-44a6-9d46-f7b022c82d6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:09.596950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf060-b8e3-44a6-9d46-f7b022c82d6a service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:09.597243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf060-b8e3-44a6-9d46-f7b022c82d6a service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:09.597525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf060-b8e3-44a6-9d46-f7b022c82d6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:09.657480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcf060-b8e3-44a6-9d46-f7b022c82d6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:09.659087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcf060-b8e3-44a6-9d46-f7b022c82d6a service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:09.669216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1214/2414] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:36:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:36:10.777370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b968-b0c8-43f2-b3ce-5a32774f224d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:10.777852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b968-b0c8-43f2-b3ce-5a32774f224d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:10.777973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b968-b0c8-43f2-b3ce-5a32774f224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:10.795337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9608b968-b0c8-43f2-b3ce-5a32774f224d None None] MFA Rules not processed for user `40ea9ac94d1d4569a2c4620ea18826d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:36:10.796532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9608b968-b0c8-43f2-b3ce-5a32774f224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:10.803356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1201/2415] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:36:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:36:15.868884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fca9fd-da4f-44e1-b634-79830104cdd6 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:15.869494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fca9fd-da4f-44e1-b634-79830104cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:15.869823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fca9fd-da4f-44e1-b634-79830104cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:15.889516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-01fca9fd-da4f-44e1-b634-79830104cdd6 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:36:15.891286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-01fca9fd-da4f-44e1-b634-79830104cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:15.947584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1215/2416] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jul 12 14:36:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:36:15.960378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b968-b0c8-43f2-b3ce-5a32774f224d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:15.961778 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9608b968-b0c8-43f2-b3ce-5a32774f224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:16.033210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b968-b0c8-43f2-b3ce-5a32774f224d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:16.038923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:16.039614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:16.039891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:16.040174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:16.049001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:16.050616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:16.068279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1202/2417] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:36:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:36:25.940751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:INSERT=1,keystone:SELECT=83 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:26.058181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=79 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:27.235823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fca9fd-da4f-44e1-b634-79830104cdd6 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:27.237234 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-01fca9fd-da4f-44e1-b634-79830104cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:27.310628 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fca9fd-da4f-44e1-b634-79830104cdd6 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:27.316176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec6ac8-0e0b-4c07-9570-23008ee1657a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:27.316833 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec6ac8-0e0b-4c07-9570-23008ee1657a service placement] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:27.317122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec6ac8-0e0b-4c07-9570-23008ee1657a service placement] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:27.317407 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec6ac8-0e0b-4c07-9570-23008ee1657a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:27.319207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ecec6ac8-0e0b-4c07-9570-23008ee1657a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:27.331195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec6ac8-0e0b-4c07-9570-23008ee1657a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:27.333111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec6ac8-0e0b-4c07-9570-23008ee1657a service placement] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:27.342933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1216/2418] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:36:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:36:37.338823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=32 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:40.721412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:36:40.723088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:40.786860 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bcc47-63e7-4b75-8732-e90e88ab5b75 service swift] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:36:40.790670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed567a-9106-470d-bf57-2017115d3b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:36:40.791371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed567a-9106-470d-bf57-2017115d3b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:40.791659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed567a-9106-470d-bf57-2017115d3b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:40.791939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed567a-9106-470d-bf57-2017115d3b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:40.801827 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed567a-9106-470d-bf57-2017115d3b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:36:40.803290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed567a-9106-470d-bf57-2017115d3b79 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:36:40.812904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1203/2419] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:36:40.866875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885498b-920a-46e5-b513-c8f0d5086243 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:40.867401 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885498b-920a-46e5-b513-c8f0d5086243 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:40.867500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885498b-920a-46e5-b513-c8f0d5086243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:40.885284 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d885498b-920a-46e5-b513-c8f0d5086243 None None] MFA Rules not processed for user `3522c9dae7854c2395b6a00a9094b10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:36:40.886503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d885498b-920a-46e5-b513-c8f0d5086243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:40.943648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1217/2420] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:36:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:36:50.808719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=26 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:50.935810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=25 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:58.362234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f04c-e4fa-479c-a9a8-785b11a7dc70 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:36:58.362738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f04c-e4fa-479c-a9a8-785b11a7dc70 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:36:58.362875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917f04c-e4fa-479c-a9a8-785b11a7dc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:36:58.380884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3917f04c-e4fa-479c-a9a8-785b11a7dc70 None None] MFA Rules not processed for user `27cbfa54860940bc84e576943c0b9503`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:36:58.382066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3917f04c-e4fa-479c-a9a8-785b11a7dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:36:58.435412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1204/2421] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:37:07.953514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ec34-136c-47ef-8eca-ac8c26844120 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:07.954549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ec34-136c-47ef-8eca-ac8c26844120 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:07.954644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2ec34-136c-47ef-8eca-ac8c26844120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:07.972405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-45c2ec34-136c-47ef-8eca-ac8c26844120 None None] MFA Rules not processed for user `4019001e534148e69c25c4d84b3a7f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:37:07.973592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-45c2ec34-136c-47ef-8eca-ac8c26844120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:08.026442 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1218/2422] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:37:08.428894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=25 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:18.019880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=25 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:53.650856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c8843-e392-4135-a3de-71aaa098f98e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:53.651432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c8843-e392-4135-a3de-71aaa098f98e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:53.651432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c8843-e392-4135-a3de-71aaa098f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:53.669625 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-955c8843-e392-4135-a3de-71aaa098f98e None None] MFA Rules not processed for user `3522c9dae7854c2395b6a00a9094b10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:37:53.670857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-955c8843-e392-4135-a3de-71aaa098f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:53.678161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1205/2423] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:37:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:03.664145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:12.023453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709645d7-d3d1-474f-b5f0-deeddab61e37 None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.023985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709645d7-d3d1-474f-b5f0-deeddab61e37 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.024081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709645d7-d3d1-474f-b5f0-deeddab61e37 None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.025467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1219/2424] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:38:12.032372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a569e-1f82-490c-9ce3-1f39a1795200 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.032848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a569e-1f82-490c-9ce3-1f39a1795200 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.032945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a569e-1f82-490c-9ce3-1f39a1795200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.053559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fa2a569e-1f82-490c-9ce3-1f39a1795200 None None] MFA Rules not processed for user `f63e307bc2f445dbaa67aac26dadbb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:12.054797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fa2a569e-1f82-490c-9ce3-1f39a1795200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:12.068492 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1206/2425] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:38:12.080554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709645d7-d3d1-474f-b5f0-deeddab61e37 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.082487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-709645d7-d3d1-474f-b5f0-deeddab61e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:12.091530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a569e-1f82-490c-9ce3-1f39a1795200 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.093200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fa2a569e-1f82-490c-9ce3-1f39a1795200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:12.105434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709645d7-d3d1-474f-b5f0-deeddab61e37 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.110466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cf4a-4b93-4ec2-836c-e7020e417ae5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.111158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cf4a-4b93-4ec2-836c-e7020e417ae5 service placement] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.111649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cf4a-4b93-4ec2-836c-e7020e417ae5 service placement] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.111935 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cf4a-4b93-4ec2-836c-e7020e417ae5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.121562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0cf4a-4b93-4ec2-836c-e7020e417ae5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.123201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0cf4a-4b93-4ec2-836c-e7020e417ae5 service placement] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:12.134392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1220/2426] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:12.171098 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a569e-1f82-490c-9ce3-1f39a1795200 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.176359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.177796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.178157 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.178415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] PATH_INFO: `/v3/users/27cbfa54860940bc84e576943c0b9503` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.179657 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cbfa54860940bc84e576943c0b9503)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.181579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:12.234100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cbfa54860940bc84e576943c0b9503'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.234810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cbfa54860940bc84e576943c0b9503'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.244416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cbfa54860940bc84e576943c0b9503'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.251839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cbfa54860940bc84e576943c0b9503'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.264807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9dba9a54-4be2-4051-a1d4-d719ad4b85a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cbfa54860940bc84e576943c0b9503'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.271960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1207/2427] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:38:12 2022] DELETE /identity/v3/users/27cbfa54860940bc84e576943c0b9503 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:38:12.440910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cf4a-4b93-4ec2-836c-e7020e417ae5 service placement] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.453030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cf4a-4b93-4ec2-836c-e7020e417ae5 service placement] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.511861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.512733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.513017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.513292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] PATH_INFO: `/v3/projects/ead62006ce2c419ab76d5dfdea0a189b` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.514454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead62006ce2c419ab76d5dfdea0a189b)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.516416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:12.565318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead62006ce2c419ab76d5dfdea0a189b', 'request_id': 'req-bb85e8f7-1004-4aef-b643-f624930ae6b3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.571384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead62006ce2c419ab76d5dfdea0a189b', 'request_id': 'req-bb85e8f7-1004-4aef-b643-f624930ae6b3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.577391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead62006ce2c419ab76d5dfdea0a189b', 'request_id': 'req-bb85e8f7-1004-4aef-b643-f624930ae6b3'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.589636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] The token cache is being invalidate because project ead62006ce2c419ab76d5dfdea0a189b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:38:12.589924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.590543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bb85e8f7-1004-4aef-b643-f624930ae6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:38:12.592106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1221/2428] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:38:12 2022] DELETE /identity/v3/projects/ead62006ce2c419ab76d5dfdea0a189b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:38:12.597091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f4e77-0234-4f45-a05c-a4d3d436d858 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.597479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f4e77-0234-4f45-a05c-a4d3d436d858 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.597796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f4e77-0234-4f45-a05c-a4d3d436d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.616025 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-900f4e77-0234-4f45-a05c-a4d3d436d858 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:12.617218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-900f4e77-0234-4f45-a05c-a4d3d436d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:12.674304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1208/2429] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:12.682397 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99e229-f054-4417-ac0f-d802304d41da None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.682694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99e229-f054-4417-ac0f-d802304d41da None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.683015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99e229-f054-4417-ac0f-d802304d41da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.700917 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ed99e229-f054-4417-ac0f-d802304d41da None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:12.702119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ed99e229-f054-4417-ac0f-d802304d41da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:12.709903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1222/2430] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:12.713941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f4e77-0234-4f45-a05c-a4d3d436d858 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.723486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f4e77-0234-4f45-a05c-a4d3d436d858 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.728505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.729164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.729457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.729746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.730474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:38:12.730811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.732427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:12.741347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:12.745021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1209/2431] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:38:12.749034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99e229-f054-4417-ac0f-d802304d41da None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.758166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99e229-f054-4417-ac0f-d802304d41da None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.762717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5a1be-9547-47c7-985f-48f0b1bec197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.763400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5a1be-9547-47c7-985f-48f0b1bec197 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.763686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5a1be-9547-47c7-985f-48f0b1bec197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.763966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5a1be-9547-47c7-985f-48f0b1bec197 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.764646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5a1be-9547-47c7-985f-48f0b1bec197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.766570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5a1be-9547-47c7-985f-48f0b1bec197 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:12.791918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1223/2432] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:38:12 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:38:12.796164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.806904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d67334-4b6b-4a0a-8fd4-f88934edbf0d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.860945 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897281-c8a3-4fcc-98a8-349752ad9c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.861645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897281-c8a3-4fcc-98a8-349752ad9c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.861933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897281-c8a3-4fcc-98a8-349752ad9c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.862214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897281-c8a3-4fcc-98a8-349752ad9c8b admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.862944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b897281-c8a3-4fcc-98a8-349752ad9c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.865444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b897281-c8a3-4fcc-98a8-349752ad9c8b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:12.884460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1210/2433] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:38:12 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:38:12.888807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5a1be-9547-47c7-985f-48f0b1bec197 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.899305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5a1be-9547-47c7-985f-48f0b1bec197 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.904118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b4f4a-f21f-48b7-981a-fa47472aa53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.904773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4f4a-f21f-48b7-981a-fa47472aa53d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.905059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4f4a-f21f-48b7-981a-fa47472aa53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.905337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4f4a-f21f-48b7-981a-fa47472aa53d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.906129 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4f4a-f21f-48b7-981a-fa47472aa53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.907762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4f4a-f21f-48b7-981a-fa47472aa53d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:12.918803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1224/2434] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:38:12.922491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897281-c8a3-4fcc-98a8-349752ad9c8b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.932747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897281-c8a3-4fcc-98a8-349752ad9c8b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.937288 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e372-4f11-470f-84bf-e3e463d5db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.937939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e372-4f11-470f-84bf-e3e463d5db6c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.938225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e372-4f11-470f-84bf-e3e463d5db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.938502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e372-4f11-470f-84bf-e3e463d5db6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.939258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597e372-4f11-470f-84bf-e3e463d5db6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.940825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597e372-4f11-470f-84bf-e3e463d5db6c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:12.950839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1211/2435] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:38:12.954709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b4f4a-f21f-48b7-981a-fa47472aa53d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:12.964374 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b4f4a-f21f-48b7-981a-fa47472aa53d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:12.968844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:12.969716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:12.970001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:12.970278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] PATH_INFO: `/v3/projects/84702461af02466ca46283288ff784de/users/347a04ca096d4dd7aa8bd7f34430e841/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:12.989305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] RBAC: Authorizing `identity:create_grant(project_id=84702461af02466ca46283288ff784de, user_id=347a04ca096d4dd7aa8bd7f34430e841, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:12.992568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:13.004911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1225/2436] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:38:12 2022] PUT /identity/v3/projects/84702461af02466ca46283288ff784de/users/347a04ca096d4dd7aa8bd7f34430e841/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:38:13.009965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000abac-423a-43d6-8a53-db93eb0b8918 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:13.010285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000abac-423a-43d6-8a53-db93eb0b8918 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:13.010571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000abac-423a-43d6-8a53-db93eb0b8918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:13.028260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d000abac-423a-43d6-8a53-db93eb0b8918 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:13.029453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d000abac-423a-43d6-8a53-db93eb0b8918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:13.087387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1212/2437] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:13.096741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:13.098474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:13.112920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:13.156821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0e19-982e-417a-8797-beb59ac371da admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:13.160408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:13.161055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:13.161347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:13.162163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:13.171270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:13.172739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:13.181947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1226/2438] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:17.344323 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703cc86-f3cf-433f-83d1-7953aed8d418 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:17.345196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703cc86-f3cf-433f-83d1-7953aed8d418 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:17.345484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703cc86-f3cf-433f-83d1-7953aed8d418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:17.380366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c703cc86-f3cf-433f-83d1-7953aed8d418 None None] MFA Rules not processed for user `347a04ca096d4dd7aa8bd7f34430e841`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:17.384174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c703cc86-f3cf-433f-83d1-7953aed8d418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:17.481190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1213/2439] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:17.496646 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:17.498182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:17.595865 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9771-c760-4e02-85cc-0b28c44d1d0d service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:17.602074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19a28-2032-420e-a525-ef0802f0d3bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:17.602762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19a28-2032-420e-a525-ef0802f0d3bf service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:17.603117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19a28-2032-420e-a525-ef0802f0d3bf service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:17.603403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19a28-2032-420e-a525-ef0802f0d3bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:17.615928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19a28-2032-420e-a525-ef0802f0d3bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:17.617563 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19a28-2032-420e-a525-ef0802f0d3bf service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:17.627419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1227/2440] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:18.920146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c044265-3216-43a7-8066-00ba6cc810ab None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:18.920666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c044265-3216-43a7-8066-00ba6cc810ab None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:18.920770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c044265-3216-43a7-8066-00ba6cc810ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:18.938632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2c044265-3216-43a7-8066-00ba6cc810ab None None] MFA Rules not processed for user `347a04ca096d4dd7aa8bd7f34430e841`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:18.939976 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2c044265-3216-43a7-8066-00ba6cc810ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:18.947251 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1214/2441] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:20.976954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19a28-2032-420e-a525-ef0802f0d3bf service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:20.990648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19a28-2032-420e-a525-ef0802f0d3bf service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:20.995245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe89983-37b0-4f34-be8b-98fe54a322eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:20.996022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe89983-37b0-4f34-be8b-98fe54a322eb service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:20.996409 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe89983-37b0-4f34-be8b-98fe54a322eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:20.996787 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe89983-37b0-4f34-be8b-98fe54a322eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:20.998921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1fe89983-37b0-4f34-be8b-98fe54a322eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:21.019652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe89983-37b0-4f34-be8b-98fe54a322eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:21.022048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe89983-37b0-4f34-be8b-98fe54a322eb service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:21.035224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1228/2442] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:23.084406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c044265-3216-43a7-8066-00ba6cc810ab None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:23.088992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:23.095751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c044265-3216-43a7-8066-00ba6cc810ab None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:23.099865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:23.100514 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:23.100799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:23.101076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:23.102872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:23.116273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:23.117706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:23.128585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1215/2443] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:26.843230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513930fa-ff95-4d13-a656-12999b681a9e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:26.843695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513930fa-ff95-4d13-a656-12999b681a9e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:26.843799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513930fa-ff95-4d13-a656-12999b681a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:26.861660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-513930fa-ff95-4d13-a656-12999b681a9e None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:26.862895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-513930fa-ff95-4d13-a656-12999b681a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:26.916035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1229/2444] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:26.962203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:26.963710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:27.030961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce146c-798b-4bcf-a39e-8cf7a7353b47 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:27.035886 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:27.036540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:27.036827 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:27.037112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:27.045366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:27.047003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:27.055315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1216/2445] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:38:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:38:36.863620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513930fa-ff95-4d13-a656-12999b681a9e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:36.876657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513930fa-ff95-4d13-a656-12999b681a9e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:36.881968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:36.882620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:36.882939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:36.883218 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:36.884987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:36.916881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:36.946757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:36.948712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:36.958802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1230/2446] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:37.051940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=37 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:40.482235 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:40.483725 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:40.552096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dead1-23f8-49ca-b395-4bd5321fcd27 service swift] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:40.557201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5973a7-beaf-4179-af52-8689f5b8713d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:40.557885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5973a7-beaf-4179-af52-8689f5b8713d service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:40.558178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5973a7-beaf-4179-af52-8689f5b8713d service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:40.558463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5973a7-beaf-4179-af52-8689f5b8713d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:40.560267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7e5973a7-beaf-4179-af52-8689f5b8713d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:40.571989 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5973a7-beaf-4179-af52-8689f5b8713d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:40.573568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5973a7-beaf-4179-af52-8689f5b8713d service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:40.583339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1217/2447] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:42.042103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:42.051481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb373b-abc6-468a-b887-0baf8e20b49a service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:42.055722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:42.056370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:42.056651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:42.056927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:42.058702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:42.069191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:42.070624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:42.078638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1231/2448] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:42.411084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0f0b-de45-4d3b-bf2e-81d49729d15b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:42.411545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0f0b-de45-4d3b-bf2e-81d49729d15b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:42.411658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a0f0b-de45-4d3b-bf2e-81d49729d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:42.429476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d41a0f0b-de45-4d3b-bf2e-81d49729d15b None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:42.430656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d41a0f0b-de45-4d3b-bf2e-81d49729d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:42.437929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1218/2449] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:38:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:42.450001 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:42.462062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ea4b-d4b3-4848-b127-ec7359bd1cac service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:42.467057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043981b1-7058-41a3-9165-874646b34dc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:42.467698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043981b1-7058-41a3-9165-874646b34dc0 service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:42.467988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043981b1-7058-41a3-9165-874646b34dc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:42.468272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043981b1-7058-41a3-9165-874646b34dc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:42.476584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043981b1-7058-41a3-9165-874646b34dc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:42.478172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043981b1-7058-41a3-9165-874646b34dc0 service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:42.486421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1232/2450] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:38:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:38:52.423947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=35 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:52.482965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=25 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:53.745046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0f0b-de45-4d3b-bf2e-81d49729d15b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:53.746830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d41a0f0b-de45-4d3b-bf2e-81d49729d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:53.763637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a0f0b-de45-4d3b-bf2e-81d49729d15b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:53.769265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d474a-a93b-49bc-85c8-c53c6386e12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:53.769937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d474a-a93b-49bc-85c8-c53c6386e12c service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:53.770228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d474a-a93b-49bc-85c8-c53c6386e12c service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:53.770511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d474a-a93b-49bc-85c8-c53c6386e12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:53.772373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1d4d474a-a93b-49bc-85c8-c53c6386e12c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:53.831941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d474a-a93b-49bc-85c8-c53c6386e12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:53.833534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d474a-a93b-49bc-85c8-c53c6386e12c service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:53.842695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1219/2451] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:56.718862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043981b1-7058-41a3-9165-874646b34dc0 service swift] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:56.730220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043981b1-7058-41a3-9165-874646b34dc0 service swift] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:56.733958 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986578bb-111e-47cc-95e6-a75a1dd19d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:56.734604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986578bb-111e-47cc-95e6-a75a1dd19d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:56.734930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986578bb-111e-47cc-95e6-a75a1dd19d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:56.735209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986578bb-111e-47cc-95e6-a75a1dd19d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:56.737205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-986578bb-111e-47cc-95e6-a75a1dd19d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:56.747255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986578bb-111e-47cc-95e6-a75a1dd19d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:56.748718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986578bb-111e-47cc-95e6-a75a1dd19d20 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:56.757535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1233/2452] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:56.863569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7efa-1282-4c3a-a795-7a3494027857 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:56.864116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7efa-1282-4c3a-a795-7a3494027857 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:56.864220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7efa-1282-4c3a-a795-7a3494027857 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:56.865649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1220/2453] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:38:56.872046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab970b-b4e3-41f2-936d-909af99b3438 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:56.872343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab970b-b4e3-41f2-936d-909af99b3438 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:56.872630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab970b-b4e3-41f2-936d-909af99b3438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:56.891510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-35ab970b-b4e3-41f2-936d-909af99b3438 None None] MFA Rules not processed for user `18d55b1fd69640548e7b35258e33e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:56.892718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-35ab970b-b4e3-41f2-936d-909af99b3438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:56.899896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1234/2454] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:38:56.912608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7efa-1282-4c3a-a795-7a3494027857 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:56.914373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9c8e7efa-1282-4c3a-a795-7a3494027857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:56.928722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7efa-1282-4c3a-a795-7a3494027857 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:56.932472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0424f-620a-41cd-9f27-765f93b9b886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:56.933366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0424f-620a-41cd-9f27-765f93b9b886 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:56.933855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0424f-620a-41cd-9f27-765f93b9b886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:56.934340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0424f-620a-41cd-9f27-765f93b9b886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:56.944108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0424f-620a-41cd-9f27-765f93b9b886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:56.945687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0424f-620a-41cd-9f27-765f93b9b886 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:56.955761 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1221/2455] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:57.038363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e15a37-ca92-437e-871f-c93cecb234da None None] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:57.038687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e15a37-ca92-437e-871f-c93cecb234da None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:57.039036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e15a37-ca92-437e-871f-c93cecb234da None None] PATH_INFO: `/` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:57.040436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1235/2456] 10.222.0.72 () {54 vars in 921 bytes} [Tue Jul 12 14:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:38:57.046006 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13776e2f-5583-4cbb-b8f2-b20f7e730b97 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:57.046304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13776e2f-5583-4cbb-b8f2-b20f7e730b97 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:57.046586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13776e2f-5583-4cbb-b8f2-b20f7e730b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:57.064987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-13776e2f-5583-4cbb-b8f2-b20f7e730b97 None None] MFA Rules not processed for user `7926b212faa44c228ff4ad9e63ee0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:57.066175 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-13776e2f-5583-4cbb-b8f2-b20f7e730b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:57.076232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1222/2457] 10.222.0.72 () {58 vars in 1018 bytes} [Tue Jul 12 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:57.087371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e15a37-ca92-437e-871f-c93cecb234da None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:57.098124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e15a37-ca92-437e-871f-c93cecb234da None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:57.101775 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e5229-2ef7-4396-9499-f9c8a9ace335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:57.102411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e5229-2ef7-4396-9499-f9c8a9ace335 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:57.102700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e5229-2ef7-4396-9499-f9c8a9ace335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:57.103005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e5229-2ef7-4396-9499-f9c8a9ace335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:57.112850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e5229-2ef7-4396-9499-f9c8a9ace335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:57.114272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e5229-2ef7-4396-9499-f9c8a9ace335 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:57.124808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1236/2458] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:38:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:38:59.560540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb24a-cb0e-4709-9d4f-85b496c88f72 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:59.560979 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb24a-cb0e-4709-9d4f-85b496c88f72 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:59.561151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb24a-cb0e-4709-9d4f-85b496c88f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:59.580145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b9cdb24a-cb0e-4709-9d4f-85b496c88f72 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:38:59.581378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b9cdb24a-cb0e-4709-9d4f-85b496c88f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:38:59.589001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1223/2459] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jul 12 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:38:59.601237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e5229-2ef7-4396-9499-f9c8a9ace335 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:38:59.618034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e5229-2ef7-4396-9499-f9c8a9ace335 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:38:59.623166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32caad-3cb5-4a21-ac53-7eb15fe08910 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:38:59.623911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32caad-3cb5-4a21-ac53-7eb15fe08910 service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:38:59.624202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32caad-3cb5-4a21-ac53-7eb15fe08910 service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:38:59.624480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32caad-3cb5-4a21-ac53-7eb15fe08910 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:38:59.633679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32caad-3cb5-4a21-ac53-7eb15fe08910 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:38:59.635323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32caad-3cb5-4a21-ac53-7eb15fe08910 service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:38:59.643404 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1237/2460] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:38:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:04.431188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdb24a-cb0e-4709-9d4f-85b496c88f72 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:04.445649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdb24a-cb0e-4709-9d4f-85b496c88f72 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:04.451924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:04.452486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:04.452773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:04.453059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:04.459027 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:04.474028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:04.476367 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:04.489025 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1224/2461] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:07.788007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32caad-3cb5-4a21-ac53-7eb15fe08910 service swift] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:07.800623 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32caad-3cb5-4a21-ac53-7eb15fe08910 service swift] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:07.807201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:07.808030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:07.808337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:07.808619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:07.810446 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:07.823816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:07.825406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:07.836595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1238/2462] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:09.654729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:09.664475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e30e86-7a99-4f55-8aba-cb0df4b3ee85 service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:09.668289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:09.668930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:09.669220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:09.669500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:09.671286 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:09.683301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:09.684718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:09.694174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1225/2463] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:12.934587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:12.936229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:12.952647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51e957-3e5c-4ead-bd63-9b8e3d93db0c service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:12.958431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:12.960300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:12.960581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:12.960905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] PATH_INFO: `/v3/users/3522c9dae7854c2395b6a00a9094b10e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:12.962125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3522c9dae7854c2395b6a00a9094b10e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:12.964096 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.009091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3522c9dae7854c2395b6a00a9094b10e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.020364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3522c9dae7854c2395b6a00a9094b10e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.021015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3522c9dae7854c2395b6a00a9094b10e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.028548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3522c9dae7854c2395b6a00a9094b10e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.035303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-6ccdbf73-33f7-479c-ab7f-a4affe88a871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3522c9dae7854c2395b6a00a9094b10e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.041082 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1239/2464] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:12 2022] DELETE /identity/v3/users/3522c9dae7854c2395b6a00a9094b10e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:13.207784 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.219046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751004f-e638-427e-96db-dc2d42450623 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:13.277355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:13.278329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.278731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.279054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] PATH_INFO: `/v3/projects/590d617afb4e41678fb89d6130fa4a79` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.280248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=590d617afb4e41678fb89d6130fa4a79)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:13.282184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.330898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:13.332137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590d617afb4e41678fb89d6130fa4a79', 'request_id': 'req-c08cee0c-207e-4b58-b4f6-b2f17374da5a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.340331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590d617afb4e41678fb89d6130fa4a79', 'request_id': 'req-c08cee0c-207e-4b58-b4f6-b2f17374da5a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.346484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590d617afb4e41678fb89d6130fa4a79', 'request_id': 'req-c08cee0c-207e-4b58-b4f6-b2f17374da5a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.360218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] The token cache is being invalidate because project 590d617afb4e41678fb89d6130fa4a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:13.360513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.361152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c08cee0c-207e-4b58-b4f6-b2f17374da5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:13.362738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1226/2465] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:13 2022] DELETE /identity/v3/projects/590d617afb4e41678fb89d6130fa4a79 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:13.368780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822fecf-ec09-4871-ae22-278d1d246a67 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.368998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822fecf-ec09-4871-ae22-278d1d246a67 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.369271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822fecf-ec09-4871-ae22-278d1d246a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.388759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4822fecf-ec09-4871-ae22-278d1d246a67 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:13.389928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4822fecf-ec09-4871-ae22-278d1d246a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:13.448232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1240/2466] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:13.456136 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef08da0-2107-4994-ac3c-e6121e738241 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.456439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef08da0-2107-4994-ac3c-e6121e738241 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.456730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef08da0-2107-4994-ac3c-e6121e738241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.474615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-eef08da0-2107-4994-ac3c-e6121e738241 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:13.476373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-eef08da0-2107-4994-ac3c-e6121e738241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:13.484296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1227/2467] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:13.488254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822fecf-ec09-4871-ae22-278d1d246a67 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.498348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822fecf-ec09-4871-ae22-278d1d246a67 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:13.502803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:13.503464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.503861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.504146 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.504870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:13.505179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:13.507324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.515717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:13.519125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1241/2468] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:13.524047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef08da0-2107-4994-ac3c-e6121e738241 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.533315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef08da0-2107-4994-ac3c-e6121e738241 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:13.537918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b56ecb-29e0-4a6c-ab3d-fb4945f25f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:13.538569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56ecb-29e0-4a6c-ab3d-fb4945f25f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.538898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56ecb-29e0-4a6c-ab3d-fb4945f25f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.539183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b56ecb-29e0-4a6c-ab3d-fb4945f25f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.539869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b56ecb-29e0-4a6c-ab3d-fb4945f25f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:13.541765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b56ecb-29e0-4a6c-ab3d-fb4945f25f8e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.567368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1228/2469] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:13 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:13.572157 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.582073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4145f7-1fd3-410e-b008-64ce28fe0da2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:13.636979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be769b-1b76-4281-84da-b0147548edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:13.637653 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be769b-1b76-4281-84da-b0147548edb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.637947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be769b-1b76-4281-84da-b0147548edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.638230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be769b-1b76-4281-84da-b0147548edb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.639015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be769b-1b76-4281-84da-b0147548edb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:13.640894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be769b-1b76-4281-84da-b0147548edb5 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.660608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1242/2470] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:13 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:13.664693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b56ecb-29e0-4a6c-ab3d-fb4945f25f8e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.675256 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b56ecb-29e0-4a6c-ab3d-fb4945f25f8e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:13.679787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d46706-da4b-4a34-bcfd-b20d523bfbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:13.680443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46706-da4b-4a34-bcfd-b20d523bfbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.680729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46706-da4b-4a34-bcfd-b20d523bfbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.681003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d46706-da4b-4a34-bcfd-b20d523bfbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.681718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d46706-da4b-4a34-bcfd-b20d523bfbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:13.683328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d46706-da4b-4a34-bcfd-b20d523bfbc6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.693536 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1229/2471] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:13.697880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be769b-1b76-4281-84da-b0147548edb5 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.707703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be769b-1b76-4281-84da-b0147548edb5 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:13.712920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ad31d-97a4-42ff-8d39-baff65cb4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:13.713595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad31d-97a4-42ff-8d39-baff65cb4227 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.713880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad31d-97a4-42ff-8d39-baff65cb4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.714156 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad31d-97a4-42ff-8d39-baff65cb4227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.714908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ad31d-97a4-42ff-8d39-baff65cb4227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:13.716483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ad31d-97a4-42ff-8d39-baff65cb4227 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.726210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1243/2472] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:13.729993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d46706-da4b-4a34-bcfd-b20d523bfbc6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.739619 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d46706-da4b-4a34-bcfd-b20d523bfbc6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:13.744066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb72d70-c4ee-4126-86dd-04630785ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:13.744934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72d70-c4ee-4126-86dd-04630785ff25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.745220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72d70-c4ee-4126-86dd-04630785ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.745498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72d70-c4ee-4126-86dd-04630785ff25 admin admin] PATH_INFO: `/v3/projects/da1b0643cb774303bbf0dc09d3a58c13/users/f3e454c7b2ba4a40b6d3f280389337bc/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.760916 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb72d70-c4ee-4126-86dd-04630785ff25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1b0643cb774303bbf0dc09d3a58c13, user_id=f3e454c7b2ba4a40b6d3f280389337bc, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:13.763558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb72d70-c4ee-4126-86dd-04630785ff25 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.777866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1230/2473] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:13 2022] PUT /identity/v3/projects/da1b0643cb774303bbf0dc09d3a58c13/users/f3e454c7b2ba4a40b6d3f280389337bc/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:13.788649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e11e3-9c8e-48a6-945d-ca99cc052e92 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.788944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e11e3-9c8e-48a6-945d-ca99cc052e92 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.789227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e11e3-9c8e-48a6-945d-ca99cc052e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.815283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e09e11e3-9c8e-48a6-945d-ca99cc052e92 None None] MFA Rules not processed for user `f3e454c7b2ba4a40b6d3f280389337bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:13.816486 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e09e11e3-9c8e-48a6-945d-ca99cc052e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:13.878188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1244/2474] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:13.883265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb72d70-c4ee-4126-86dd-04630785ff25 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.943135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb72d70-c4ee-4126-86dd-04630785ff25 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:13.948282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2812b8-b78d-4484-be13-93b250ceefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:13.948948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2812b8-b78d-4484-be13-93b250ceefaf admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:13.949237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2812b8-b78d-4484-be13-93b250ceefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:13.949517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2812b8-b78d-4484-be13-93b250ceefaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:13.950199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2812b8-b78d-4484-be13-93b250ceefaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:13.952123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2812b8-b78d-4484-be13-93b250ceefaf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:13.975711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1231/2475] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:13 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:13.979814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e11e3-9c8e-48a6-945d-ca99cc052e92 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:13.990170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e11e3-9c8e-48a6-945d-ca99cc052e92 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:14.044240 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2dd25-fb08-42cd-9f60-de0d3361feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:14.044911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2dd25-fb08-42cd-9f60-de0d3361feed admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.045198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2dd25-fb08-42cd-9f60-de0d3361feed admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.045478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2dd25-fb08-42cd-9f60-de0d3361feed admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.046172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2dd25-fb08-42cd-9f60-de0d3361feed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:14.048145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2dd25-fb08-42cd-9f60-de0d3361feed admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:14.062884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:14.069936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1245/2476] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:13 2022] POST /identity/v3/users => generated 309 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:39:14.073573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2812b8-b78d-4484-be13-93b250ceefaf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:14.083980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2812b8-b78d-4484-be13-93b250ceefaf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:14.088659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a349e2-4771-4b8e-844e-8e2886ac193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:14.089338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a349e2-4771-4b8e-844e-8e2886ac193a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.089630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a349e2-4771-4b8e-844e-8e2886ac193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.089914 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a349e2-4771-4b8e-844e-8e2886ac193a admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.090648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a349e2-4771-4b8e-844e-8e2886ac193a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:14.092294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a349e2-4771-4b8e-844e-8e2886ac193a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:14.102603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1232/2477] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:14.106470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2dd25-fb08-42cd-9f60-de0d3361feed admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:14.116847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2dd25-fb08-42cd-9f60-de0d3361feed admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:14.121392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd550058-c001-4c66-acd2-93b912cd4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:14.122265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd550058-c001-4c66-acd2-93b912cd4051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.122550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd550058-c001-4c66-acd2-93b912cd4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.122856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd550058-c001-4c66-acd2-93b912cd4051 admin admin] PATH_INFO: `/v3/projects/b16c9eebd5cd4571b911eec5b191759c/users/17f1ce23180e40fa91e158897df81ba3/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.137598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd550058-c001-4c66-acd2-93b912cd4051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16c9eebd5cd4571b911eec5b191759c, user_id=17f1ce23180e40fa91e158897df81ba3, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:14.140269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd550058-c001-4c66-acd2-93b912cd4051 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:14.153192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1246/2478] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:14 2022] PUT /identity/v3/projects/b16c9eebd5cd4571b911eec5b191759c/users/17f1ce23180e40fa91e158897df81ba3/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:14.157082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a349e2-4771-4b8e-844e-8e2886ac193a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:14.167765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a349e2-4771-4b8e-844e-8e2886ac193a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:14.211156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:14.224589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531d118-b368-4407-8417-c0c2cfa8fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:14.225754 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531d118-b368-4407-8417-c0c2cfa8fa85 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.226111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531d118-b368-4407-8417-c0c2cfa8fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.226412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531d118-b368-4407-8417-c0c2cfa8fa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.227208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531d118-b368-4407-8417-c0c2cfa8fa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:14.228808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531d118-b368-4407-8417-c0c2cfa8fa85 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:14.238401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1233/2479] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:14.243149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd550058-c001-4c66-acd2-93b912cd4051 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:14.253428 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd550058-c001-4c66-acd2-93b912cd4051 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:14.258048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:14.258967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.259255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.259539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] PATH_INFO: `/v3/projects/b16c9eebd5cd4571b911eec5b191759c/users/17f1ce23180e40fa91e158897df81ba3/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.261510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16c9eebd5cd4571b911eec5b191759c, user_id=17f1ce23180e40fa91e158897df81ba3, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:14.264205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:14.274290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1247/2480] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:14 2022] PUT /identity/v3/projects/b16c9eebd5cd4571b911eec5b191759c/users/17f1ce23180e40fa91e158897df81ba3/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:14.284311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cfc00-2a25-4721-bf15-ce11db15b8ec None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.284614 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cfc00-2a25-4721-bf15-ce11db15b8ec None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.284905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cfc00-2a25-4721-bf15-ce11db15b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.311839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-972cfc00-2a25-4721-bf15-ce11db15b8ec None None] MFA Rules not processed for user `17f1ce23180e40fa91e158897df81ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:14.313049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-972cfc00-2a25-4721-bf15-ce11db15b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:14.379685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1234/2481] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:14.390169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:14.391891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:14.448800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee72c1-2b44-4088-9c5e-7eb31b44abc2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:14.452464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c177-759a-4c85-b785-4267e0ad5e54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:14.453106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c177-759a-4c85-b785-4267e0ad5e54 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.453394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c177-759a-4c85-b785-4267e0ad5e54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.453673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c177-759a-4c85-b785-4267e0ad5e54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.462698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9c177-759a-4c85-b785-4267e0ad5e54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:14.464126 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9c177-759a-4c85-b785-4267e0ad5e54 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:14.473463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1248/2482] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:14 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:14.618395 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cfc00-2a25-4721-bf15-ce11db15b8ec None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:14.680545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cfc00-2a25-4721-bf15-ce11db15b8ec None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:14.685047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:14.685928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.686217 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.686496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] PATH_INFO: `/v3/users/f3e454c7b2ba4a40b6d3f280389337bc` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.687707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e454c7b2ba4a40b6d3f280389337bc)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:14.689620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:14.734045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e454c7b2ba4a40b6d3f280389337bc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:14.734618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e454c7b2ba4a40b6d3f280389337bc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:14.741147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e454c7b2ba4a40b6d3f280389337bc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:14.748096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e454c7b2ba4a40b6d3f280389337bc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:14.753444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:14.762144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e454c7b2ba4a40b6d3f280389337bc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:14.768442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1235/2483] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:14 2022] DELETE /identity/v3/users/f3e454c7b2ba4a40b6d3f280389337bc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:14.773499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5b59f-7ba4-486b-8623-8670de066046 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.773792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5b59f-7ba4-486b-8623-8670de066046 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.774075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5b59f-7ba4-486b-8623-8670de066046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.791746 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-d5d5b59f-7ba4-486b-8623-8670de066046 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:14.793282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d5d5b59f-7ba4-486b-8623-8670de066046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:14.851075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1249/2484] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:14.860667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:14.862096 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:14.919909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b23e8-fafe-4b63-a3c9-dbb16cb683d3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:14.923607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934dad7-d06b-49b5-af27-8e0d634b97cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:14.924258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934dad7-d06b-49b5-af27-8e0d634b97cd service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:14.924549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934dad7-d06b-49b5-af27-8e0d634b97cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:14.924831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934dad7-d06b-49b5-af27-8e0d634b97cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:14.933772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934dad7-d06b-49b5-af27-8e0d634b97cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:14.935236 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934dad7-d06b-49b5-af27-8e0d634b97cd service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:14.945026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1236/2485] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:15.202158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5b59f-7ba4-486b-8623-8670de066046 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:15.203701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d5d5b59f-7ba4-486b-8623-8670de066046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:15.215921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5b59f-7ba4-486b-8623-8670de066046 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:15.221199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:15.222564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:15.222898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:15.223391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] PATH_INFO: `/v3/projects/da1b0643cb774303bbf0dc09d3a58c13` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:15.224590 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1b0643cb774303bbf0dc09d3a58c13)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:15.227125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:15.273107 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1b0643cb774303bbf0dc09d3a58c13', 'request_id': 'req-a8373187-2929-44eb-b5b9-28aec6effe49'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.278417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1b0643cb774303bbf0dc09d3a58c13', 'request_id': 'req-a8373187-2929-44eb-b5b9-28aec6effe49'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.279522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.286176 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1b0643cb774303bbf0dc09d3a58c13', 'request_id': 'req-a8373187-2929-44eb-b5b9-28aec6effe49'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.299101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] The token cache is being invalidate because project da1b0643cb774303bbf0dc09d3a58c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:15.299405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.300044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.301567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1250/2486] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:15 2022] DELETE /identity/v3/projects/da1b0643cb774303bbf0dc09d3a58c13 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:15.305509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934dad7-d06b-49b5-af27-8e0d634b97cd service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:15.315079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934dad7-d06b-49b5-af27-8e0d634b97cd service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:15.372126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:15.373002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:15.373290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:15.373572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] PATH_INFO: `/v3/users/17f1ce23180e40fa91e158897df81ba3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:15.374750 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f1ce23180e40fa91e158897df81ba3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:15.376705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:15.421024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f1ce23180e40fa91e158897df81ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.421664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f1ce23180e40fa91e158897df81ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.429264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f1ce23180e40fa91e158897df81ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.436281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f1ce23180e40fa91e158897df81ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.448446 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e17b971c-0bdf-41b5-b6e2-e2e7676fd62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f1ce23180e40fa91e158897df81ba3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.454223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1237/2487] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:15 2022] DELETE /identity/v3/users/17f1ce23180e40fa91e158897df81ba3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:15.713782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:15.715244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:15.728874 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373187-2929-44eb-b5b9-28aec6effe49 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:15.784447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:15.785321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:15.785607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:15.785886 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] PATH_INFO: `/v3/projects/b16c9eebd5cd4571b911eec5b191759c` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:15.787092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16c9eebd5cd4571b911eec5b191759c)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:15.789549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:15.834897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16c9eebd5cd4571b911eec5b191759c', 'request_id': 'req-58d11316-5fa5-4747-bef0-94060c8ce232'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.840160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16c9eebd5cd4571b911eec5b191759c', 'request_id': 'req-58d11316-5fa5-4747-bef0-94060c8ce232'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.846020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16c9eebd5cd4571b911eec5b191759c', 'request_id': 'req-58d11316-5fa5-4747-bef0-94060c8ce232'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.858943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] The token cache is being invalidate because project b16c9eebd5cd4571b911eec5b191759c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:15.859230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.859847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-58d11316-5fa5-4747-bef0-94060c8ce232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:15.861361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1251/2488] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:15 2022] DELETE /identity/v3/projects/b16c9eebd5cd4571b911eec5b191759c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:15.866830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac709d-7483-4e39-835f-76338f08c2e0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:15.867131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac709d-7483-4e39-835f-76338f08c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:15.867413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac709d-7483-4e39-835f-76338f08c2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:15.885767 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-53ac709d-7483-4e39-835f-76338f08c2e0 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:15.887005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-53ac709d-7483-4e39-835f-76338f08c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:15.891292 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:15.948221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1238/2489] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:15.956100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de499f-91fa-485e-af0b-67d15a36d6f7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:15.956393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de499f-91fa-485e-af0b-67d15a36d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:15.956677 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de499f-91fa-485e-af0b-67d15a36d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:15.974319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f7de499f-91fa-485e-af0b-67d15a36d6f7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:15.976055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f7de499f-91fa-485e-af0b-67d15a36d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:15.983748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1252/2490] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:15.987823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac709d-7483-4e39-835f-76338f08c2e0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:15.998118 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac709d-7483-4e39-835f-76338f08c2e0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.002656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.003343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.003630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.003909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.004630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:16.004936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.007076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.018332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1239/2491] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:16.023147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de499f-91fa-485e-af0b-67d15a36d6f7 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.032283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de499f-91fa-485e-af0b-67d15a36d6f7 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.036981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927689b2-0f75-48dc-871e-388461870ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.037659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927689b2-0f75-48dc-871e-388461870ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.037946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927689b2-0f75-48dc-871e-388461870ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.038224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927689b2-0f75-48dc-871e-388461870ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.038944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927689b2-0f75-48dc-871e-388461870ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.040834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927689b2-0f75-48dc-871e-388461870ee6 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.066980 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1253/2492] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:16 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:16.071839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.081634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b775d-71b5-4443-8621-0b24d0cccd56 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.258982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef00ba-d4c1-457e-8943-319c1a48d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.259689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef00ba-d4c1-457e-8943-319c1a48d156 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.259973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef00ba-d4c1-457e-8943-319c1a48d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.260246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef00ba-d4c1-457e-8943-319c1a48d156 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.260932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef00ba-d4c1-457e-8943-319c1a48d156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.262911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef00ba-d4c1-457e-8943-319c1a48d156 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.282097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1240/2493] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:16 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:16.286369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927689b2-0f75-48dc-871e-388461870ee6 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.296852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927689b2-0f75-48dc-871e-388461870ee6 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.301372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa9cf7-7a93-4db9-a6c5-d6bef1ec6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.302025 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9cf7-7a93-4db9-a6c5-d6bef1ec6bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.302312 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9cf7-7a93-4db9-a6c5-d6bef1ec6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.302589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9cf7-7a93-4db9-a6c5-d6bef1ec6bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.303855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa9cf7-7a93-4db9-a6c5-d6bef1ec6bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.305451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa9cf7-7a93-4db9-a6c5-d6bef1ec6bc9 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.315561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1254/2494] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:16.319869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef00ba-d4c1-457e-8943-319c1a48d156 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.329716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef00ba-d4c1-457e-8943-319c1a48d156 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.334305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4184f-f713-4071-9644-c85261c01a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.334991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4184f-f713-4071-9644-c85261c01a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.335285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4184f-f713-4071-9644-c85261c01a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.335570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4184f-f713-4071-9644-c85261c01a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.336296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4184f-f713-4071-9644-c85261c01a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.337909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4184f-f713-4071-9644-c85261c01a43 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.347698 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1241/2495] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:16.351602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa9cf7-7a93-4db9-a6c5-d6bef1ec6bc9 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.361304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa9cf7-7a93-4db9-a6c5-d6bef1ec6bc9 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.366276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628919cd-e784-45a9-81eb-67fadc0de964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.367190 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628919cd-e784-45a9-81eb-67fadc0de964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.367482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628919cd-e784-45a9-81eb-67fadc0de964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.367762 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628919cd-e784-45a9-81eb-67fadc0de964 admin admin] PATH_INFO: `/v3/projects/a8d701182c9d44db8d2b8d3ac93257bb/users/cc775bb883464f759edeba2d30db047c/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.382547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628919cd-e784-45a9-81eb-67fadc0de964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d701182c9d44db8d2b8d3ac93257bb, user_id=cc775bb883464f759edeba2d30db047c, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.385211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628919cd-e784-45a9-81eb-67fadc0de964 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.397681 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1255/2496] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:16 2022] PUT /identity/v3/projects/a8d701182c9d44db8d2b8d3ac93257bb/users/cc775bb883464f759edeba2d30db047c/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:16.408743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf7dd-3825-4ec8-bffd-691daab3d83e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.409044 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf7dd-3825-4ec8-bffd-691daab3d83e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.409334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf7dd-3825-4ec8-bffd-691daab3d83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.436389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c4aaf7dd-3825-4ec8-bffd-691daab3d83e None None] MFA Rules not processed for user `cc775bb883464f759edeba2d30db047c`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:16.437575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c4aaf7dd-3825-4ec8-bffd-691daab3d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:16.499557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1242/2497] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:16.504136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628919cd-e784-45a9-81eb-67fadc0de964 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.517148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:16.566582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628919cd-e784-45a9-81eb-67fadc0de964 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.571239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486e33-ee4a-4f3d-a845-2542562d9c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.571912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486e33-ee4a-4f3d-a845-2542562d9c8f admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.572198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486e33-ee4a-4f3d-a845-2542562d9c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.572483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486e33-ee4a-4f3d-a845-2542562d9c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.573175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5486e33-ee4a-4f3d-a845-2542562d9c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.575116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5486e33-ee4a-4f3d-a845-2542562d9c8f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.599115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1256/2498] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:16 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:16.603633 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf7dd-3825-4ec8-bffd-691daab3d83e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.610120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:16.614467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf7dd-3825-4ec8-bffd-691daab3d83e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.670515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01c838-c7ed-4068-930e-6c0a4bf90713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.671210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01c838-c7ed-4068-930e-6c0a4bf90713 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.671498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01c838-c7ed-4068-930e-6c0a4bf90713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.671793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01c838-c7ed-4068-930e-6c0a4bf90713 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.672512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01c838-c7ed-4068-930e-6c0a4bf90713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.674400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01c838-c7ed-4068-930e-6c0a4bf90713 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.693300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1243/2499] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:16 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:16.697751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486e33-ee4a-4f3d-a845-2542562d9c8f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.707912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486e33-ee4a-4f3d-a845-2542562d9c8f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.713224 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53280e5-e143-4b2b-b1e0-052618060c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.713891 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53280e5-e143-4b2b-b1e0-052618060c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.714182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53280e5-e143-4b2b-b1e0-052618060c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.714465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53280e5-e143-4b2b-b1e0-052618060c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.715246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53280e5-e143-4b2b-b1e0-052618060c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.716842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53280e5-e143-4b2b-b1e0-052618060c18 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.734848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1257/2500] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:16.738997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01c838-c7ed-4068-930e-6c0a4bf90713 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.749334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01c838-c7ed-4068-930e-6c0a4bf90713 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.754057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709763-bede-44eb-bf15-5dfa162eab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.754960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709763-bede-44eb-bf15-5dfa162eab2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.755248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709763-bede-44eb-bf15-5dfa162eab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.755526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709763-bede-44eb-bf15-5dfa162eab2b admin admin] PATH_INFO: `/v3/projects/22aaaf9e998440d199858dd60ebf2a0a/users/4664c18eb1bf49c7a84ee38e3bd56f72/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.770859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a709763-bede-44eb-bf15-5dfa162eab2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22aaaf9e998440d199858dd60ebf2a0a, user_id=4664c18eb1bf49c7a84ee38e3bd56f72, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.773985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a709763-bede-44eb-bf15-5dfa162eab2b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.787329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1244/2501] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:16 2022] PUT /identity/v3/projects/22aaaf9e998440d199858dd60ebf2a0a/users/4664c18eb1bf49c7a84ee38e3bd56f72/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:16.791570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53280e5-e143-4b2b-b1e0-052618060c18 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.801722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53280e5-e143-4b2b-b1e0-052618060c18 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.859162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbd4c7-55de-4369-89ba-0ec451cb5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.859866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd4c7-55de-4369-89ba-0ec451cb5018 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.860154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd4c7-55de-4369-89ba-0ec451cb5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.860432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd4c7-55de-4369-89ba-0ec451cb5018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.861172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbd4c7-55de-4369-89ba-0ec451cb5018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.862838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbd4c7-55de-4369-89ba-0ec451cb5018 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.873400 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1258/2502] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:16.877739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709763-bede-44eb-bf15-5dfa162eab2b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:16.888320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709763-bede-44eb-bf15-5dfa162eab2b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:16.893179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:16.894066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.894353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.894635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] PATH_INFO: `/v3/projects/22aaaf9e998440d199858dd60ebf2a0a/users/4664c18eb1bf49c7a84ee38e3bd56f72/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.896650 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22aaaf9e998440d199858dd60ebf2a0a, user_id=4664c18eb1bf49c7a84ee38e3bd56f72, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:16.900020 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:16.913439 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1245/2503] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:16 2022] PUT /identity/v3/projects/22aaaf9e998440d199858dd60ebf2a0a/users/4664c18eb1bf49c7a84ee38e3bd56f72/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:16.924099 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c4ddf-f924-4b7d-a439-04c40d1b7bab None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:16.924403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c4ddf-f924-4b7d-a439-04c40d1b7bab None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:16.924686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c4ddf-f924-4b7d-a439-04c40d1b7bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:16.950991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-3e3c4ddf-f924-4b7d-a439-04c40d1b7bab None None] MFA Rules not processed for user `4664c18eb1bf49c7a84ee38e3bd56f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:16.952208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3e3c4ddf-f924-4b7d-a439-04c40d1b7bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:17.018750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1259/2504] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:17.030301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:17.032046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:17.089701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45a8fe-d7ef-40a8-a872-b57ea04cc900 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:17.093317 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b997f-0882-4faf-912b-18cc2e747d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:17.093965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b997f-0882-4faf-912b-18cc2e747d09 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:17.094244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b997f-0882-4faf-912b-18cc2e747d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:17.094524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b997f-0882-4faf-912b-18cc2e747d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:17.104167 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b997f-0882-4faf-912b-18cc2e747d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:17.105582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b997f-0882-4faf-912b-18cc2e747d09 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:17.114872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1246/2505] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:17.184343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c4ddf-f924-4b7d-a439-04c40d1b7bab None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:17.194692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c4ddf-f924-4b7d-a439-04c40d1b7bab None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:17.199705 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79341731-5c15-4b67-affb-3ccbcbe0a8b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:17.200805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341731-5c15-4b67-affb-3ccbcbe0a8b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:17.201327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341731-5c15-4b67-affb-3ccbcbe0a8b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:17.201806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341731-5c15-4b67-affb-3ccbcbe0a8b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:17.208615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:17.262395 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79341731-5c15-4b67-affb-3ccbcbe0a8b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:17.263885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79341731-5c15-4b67-affb-3ccbcbe0a8b0 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:17.273283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1260/2506] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:23.933804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b997f-0882-4faf-912b-18cc2e747d09 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:23.994799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b997f-0882-4faf-912b-18cc2e747d09 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:23.999391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:24.000266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:24.000552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:24.000881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] PATH_INFO: `/v3/users/cc775bb883464f759edeba2d30db047c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:24.002058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc775bb883464f759edeba2d30db047c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:24.004047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:24.005560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:24.050645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc775bb883464f759edeba2d30db047c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.051330 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc775bb883464f759edeba2d30db047c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.059128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc775bb883464f759edeba2d30db047c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.066366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc775bb883464f759edeba2d30db047c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.078552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc775bb883464f759edeba2d30db047c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.084572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1247/2507] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:23 2022] DELETE /identity/v3/users/cc775bb883464f759edeba2d30db047c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:24.089529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217b24-e30f-49fc-8b0e-adfff143cd38 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:24.089998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217b24-e30f-49fc-8b0e-adfff143cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:24.090097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217b24-e30f-49fc-8b0e-adfff143cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:24.108246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-75217b24-e30f-49fc-8b0e-adfff143cd38 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:24.109431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-75217b24-e30f-49fc-8b0e-adfff143cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:24.167820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1261/2508] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:24.184575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:24.186043 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:24.244730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c724c42-7214-421f-bbd6-19fd6c0474ad admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:24.248567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a948d80-3e1e-49d3-b4e2-c59ee7ff383f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:24.249226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a948d80-3e1e-49d3-b4e2-c59ee7ff383f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:24.249511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a948d80-3e1e-49d3-b4e2-c59ee7ff383f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:24.249787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a948d80-3e1e-49d3-b4e2-c59ee7ff383f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:24.262557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a948d80-3e1e-49d3-b4e2-c59ee7ff383f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:24.264014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a948d80-3e1e-49d3-b4e2-c59ee7ff383f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:24.273765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1248/2509] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:24.538997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75217b24-e30f-49fc-8b0e-adfff143cd38 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:24.540564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-75217b24-e30f-49fc-8b0e-adfff143cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:24.552900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75217b24-e30f-49fc-8b0e-adfff143cd38 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:24.557575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:24.558437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:24.558763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:24.559089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] PATH_INFO: `/v3/projects/a8d701182c9d44db8d2b8d3ac93257bb` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:24.560271 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d701182c9d44db8d2b8d3ac93257bb)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:24.562183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:24.610668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d701182c9d44db8d2b8d3ac93257bb', 'request_id': 'req-8652254b-b6b1-4f89-b995-1e39ab796024'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.616304 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d701182c9d44db8d2b8d3ac93257bb', 'request_id': 'req-8652254b-b6b1-4f89-b995-1e39ab796024'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.622441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d701182c9d44db8d2b8d3ac93257bb', 'request_id': 'req-8652254b-b6b1-4f89-b995-1e39ab796024'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.634832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] The token cache is being invalidate because project a8d701182c9d44db8d2b8d3ac93257bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:24.635123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.635741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.637263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1262/2510] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:24 2022] DELETE /identity/v3/projects/a8d701182c9d44db8d2b8d3ac93257bb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:24.641465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a948d80-3e1e-49d3-b4e2-c59ee7ff383f service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:24.651628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a948d80-3e1e-49d3-b4e2-c59ee7ff383f service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:24.707287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:24.708147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:24.708433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:24.708710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] PATH_INFO: `/v3/users/4664c18eb1bf49c7a84ee38e3bd56f72` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:24.709873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4664c18eb1bf49c7a84ee38e3bd56f72)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:24.711849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:24.733084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:24.756576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4664c18eb1bf49c7a84ee38e3bd56f72'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.757218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4664c18eb1bf49c7a84ee38e3bd56f72'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.764563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4664c18eb1bf49c7a84ee38e3bd56f72'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.771349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4664c18eb1bf49c7a84ee38e3bd56f72'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.782888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f25772df-e617-47c9-9774-aa76b9398d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4664c18eb1bf49c7a84ee38e3bd56f72'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:24.788747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1249/2511] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:24 2022] DELETE /identity/v3/users/4664c18eb1bf49c7a84ee38e3bd56f72 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:25.054167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.055707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:25.071238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652254b-b6b1-4f89-b995-1e39ab796024 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.102399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:25.130402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.131295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.131588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.131861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] PATH_INFO: `/v3/projects/22aaaf9e998440d199858dd60ebf2a0a` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.133536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22aaaf9e998440d199858dd60ebf2a0a)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.135501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.180120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22aaaf9e998440d199858dd60ebf2a0a', 'request_id': 'req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:25.185806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22aaaf9e998440d199858dd60ebf2a0a', 'request_id': 'req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:25.192022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22aaaf9e998440d199858dd60ebf2a0a', 'request_id': 'req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:25.204268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] The token cache is being invalidate because project 22aaaf9e998440d199858dd60ebf2a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:25.204557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:25.205180 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-95b5d4ee-49e9-484d-94d4-ef2fa1fe5778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:25.206700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1263/2512] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:25 2022] DELETE /identity/v3/projects/22aaaf9e998440d199858dd60ebf2a0a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:25.212967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e8090-57a4-4f42-8040-6ce1f745ca40 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.213458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e8090-57a4-4f42-8040-6ce1f745ca40 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.213562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e8090-57a4-4f42-8040-6ce1f745ca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.231054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-592e8090-57a4-4f42-8040-6ce1f745ca40 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:25.232251 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-592e8090-57a4-4f42-8040-6ce1f745ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:25.290751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1250/2513] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:25.298806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93f01-e28f-402d-b020-fc045e48d26e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.299120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93f01-e28f-402d-b020-fc045e48d26e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.299403 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93f01-e28f-402d-b020-fc045e48d26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.317448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-62c93f01-e28f-402d-b020-fc045e48d26e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:25.318643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-62c93f01-e28f-402d-b020-fc045e48d26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:25.327046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1264/2514] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:25.331290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e8090-57a4-4f42-8040-6ce1f745ca40 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.341807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e8090-57a4-4f42-8040-6ce1f745ca40 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.347694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.348562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.348703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.348940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.349666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:25.349971 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.351610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.364228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1251/2515] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:25.368464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c93f01-e28f-402d-b020-fc045e48d26e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.377834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c93f01-e28f-402d-b020-fc045e48d26e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.383042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8c2c-9799-40a3-96a6-9c56a755a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.383650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8c2c-9799-40a3-96a6-9c56a755a297 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.383933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8c2c-9799-40a3-96a6-9c56a755a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.384207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8c2c-9799-40a3-96a6-9c56a755a297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.384902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b8c2c-9799-40a3-96a6-9c56a755a297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.386838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b8c2c-9799-40a3-96a6-9c56a755a297 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.416286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1265/2516] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:25 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:25.420425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.430892 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a966a38-d20d-49c9-80a5-ef9a0e1866a5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.484666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb24d-2ff3-4e70-aa52-ed1eb47978a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.485339 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb24d-2ff3-4e70-aa52-ed1eb47978a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.485626 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb24d-2ff3-4e70-aa52-ed1eb47978a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.485905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb24d-2ff3-4e70-aa52-ed1eb47978a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.486600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cb24d-2ff3-4e70-aa52-ed1eb47978a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.488530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cb24d-2ff3-4e70-aa52-ed1eb47978a1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.508265 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1252/2517] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:25 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:25.512306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8c2c-9799-40a3-96a6-9c56a755a297 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.522618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8c2c-9799-40a3-96a6-9c56a755a297 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.527329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6542d2-d0f0-40f2-a96d-74b48ce32857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.527994 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6542d2-d0f0-40f2-a96d-74b48ce32857 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.528285 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6542d2-d0f0-40f2-a96d-74b48ce32857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.528567 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6542d2-d0f0-40f2-a96d-74b48ce32857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.529328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6542d2-d0f0-40f2-a96d-74b48ce32857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.530959 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6542d2-d0f0-40f2-a96d-74b48ce32857 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.541203 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1266/2518] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:25.545102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb24d-2ff3-4e70-aa52-ed1eb47978a1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.555555 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb24d-2ff3-4e70-aa52-ed1eb47978a1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.560143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cae7f-1846-4b93-9de2-ae470d0b77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.560802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cae7f-1846-4b93-9de2-ae470d0b77a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.561089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cae7f-1846-4b93-9de2-ae470d0b77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.561369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cae7f-1846-4b93-9de2-ae470d0b77a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.562090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cae7f-1846-4b93-9de2-ae470d0b77a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.563695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cae7f-1846-4b93-9de2-ae470d0b77a0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.574023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1253/2519] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:25.578130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6542d2-d0f0-40f2-a96d-74b48ce32857 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.588059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6542d2-d0f0-40f2-a96d-74b48ce32857 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.592651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f26a2-b812-4f72-ba0f-563456a95cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.593527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f26a2-b812-4f72-ba0f-563456a95cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.593810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f26a2-b812-4f72-ba0f-563456a95cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.594092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f26a2-b812-4f72-ba0f-563456a95cbe admin admin] PATH_INFO: `/v3/projects/3647dba33160499b82f01cded370dc13/users/8c2e4e6b49f94058a4a53a555e38be2e/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.608450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f26a2-b812-4f72-ba0f-563456a95cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3647dba33160499b82f01cded370dc13, user_id=8c2e4e6b49f94058a4a53a555e38be2e, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.611137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f26a2-b812-4f72-ba0f-563456a95cbe admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.623921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1267/2520] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:25 2022] PUT /identity/v3/projects/3647dba33160499b82f01cded370dc13/users/8c2e4e6b49f94058a4a53a555e38be2e/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:25.635525 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cbb9e-46c4-41b4-882d-0c8a6c1f606f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.635763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cbb9e-46c4-41b4-882d-0c8a6c1f606f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.636047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cbb9e-46c4-41b4-882d-0c8a6c1f606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.648563 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:25.662732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4a4cbb9e-46c4-41b4-882d-0c8a6c1f606f None None] MFA Rules not processed for user `8c2e4e6b49f94058a4a53a555e38be2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:25.664009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4a4cbb9e-46c4-41b4-882d-0c8a6c1f606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:25.726648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1254/2521] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:25.731095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f26a2-b812-4f72-ba0f-563456a95cbe admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.787926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:25.792244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f26a2-b812-4f72-ba0f-563456a95cbe admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.798727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d5d71-4cfb-4e85-b6f8-8411f6514280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.799602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5d71-4cfb-4e85-b6f8-8411f6514280 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.799984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5d71-4cfb-4e85-b6f8-8411f6514280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.800326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5d71-4cfb-4e85-b6f8-8411f6514280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.801359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5d71-4cfb-4e85-b6f8-8411f6514280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.803666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5d71-4cfb-4e85-b6f8-8411f6514280 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.829356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1268/2522] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:25 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:25.833504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cbb9e-46c4-41b4-882d-0c8a6c1f606f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.844233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cbb9e-46c4-41b4-882d-0c8a6c1f606f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.898530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e854f8-35bc-4e6c-b6e3-004b56527c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.899238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e854f8-35bc-4e6c-b6e3-004b56527c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.899524 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e854f8-35bc-4e6c-b6e3-004b56527c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.899802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e854f8-35bc-4e6c-b6e3-004b56527c6d admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.900498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e854f8-35bc-4e6c-b6e3-004b56527c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.902389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e854f8-35bc-4e6c-b6e3-004b56527c6d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.922810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1255/2523] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:25 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:25.926847 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d5d71-4cfb-4e85-b6f8-8411f6514280 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.937785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d5d71-4cfb-4e85-b6f8-8411f6514280 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.942510 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857af37-b730-417f-a6ef-2c972357939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.943206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857af37-b730-417f-a6ef-2c972357939d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.943497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857af37-b730-417f-a6ef-2c972357939d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.943783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857af37-b730-417f-a6ef-2c972357939d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.944517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857af37-b730-417f-a6ef-2c972357939d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.946199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857af37-b730-417f-a6ef-2c972357939d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:25.957554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1269/2524] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:25.961600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e854f8-35bc-4e6c-b6e3-004b56527c6d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:25.971545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e854f8-35bc-4e6c-b6e3-004b56527c6d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:25.976075 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a69e-6894-4775-aa06-c3e3012c0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:25.977441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a69e-6894-4775-aa06-c3e3012c0a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:25.977722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a69e-6894-4775-aa06-c3e3012c0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:25.977999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a69e-6894-4775-aa06-c3e3012c0a57 admin admin] PATH_INFO: `/v3/projects/724abe6f978d42f6828cc44b1a4cee2d/users/61521ea96a814dd0b1f88790c42c7049/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:25.992904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a69e-6894-4775-aa06-c3e3012c0a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724abe6f978d42f6828cc44b1a4cee2d, user_id=61521ea96a814dd0b1f88790c42c7049, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:25.995573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a69e-6894-4775-aa06-c3e3012c0a57 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:26.007430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1256/2525] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:25 2022] PUT /identity/v3/projects/724abe6f978d42f6828cc44b1a4cee2d/users/61521ea96a814dd0b1f88790c42c7049/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:26.011256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857af37-b730-417f-a6ef-2c972357939d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:26.021087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857af37-b730-417f-a6ef-2c972357939d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:26.076487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bbab7-955e-4917-bed5-206b7900b228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:26.077164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bbab7-955e-4917-bed5-206b7900b228 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:26.077451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bbab7-955e-4917-bed5-206b7900b228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:26.077731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bbab7-955e-4917-bed5-206b7900b228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:26.078448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bbab7-955e-4917-bed5-206b7900b228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:26.080113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bbab7-955e-4917-bed5-206b7900b228 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:26.089580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1270/2526] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:26.093721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a69e-6894-4775-aa06-c3e3012c0a57 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:26.105045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a69e-6894-4775-aa06-c3e3012c0a57 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:26.109684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:26.110605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:26.110932 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:26.111226 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] PATH_INFO: `/v3/projects/724abe6f978d42f6828cc44b1a4cee2d/users/61521ea96a814dd0b1f88790c42c7049/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:26.113219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] RBAC: Authorizing `identity:create_grant(project_id=724abe6f978d42f6828cc44b1a4cee2d, user_id=61521ea96a814dd0b1f88790c42c7049, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:26.115895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:26.126733 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1257/2527] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:26 2022] PUT /identity/v3/projects/724abe6f978d42f6828cc44b1a4cee2d/users/61521ea96a814dd0b1f88790c42c7049/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:26.136771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a734-89a5-4b08-9884-d0e761805dc4 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:26.137296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a734-89a5-4b08-9884-d0e761805dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:26.137408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a734-89a5-4b08-9884-d0e761805dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:26.163420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1308a734-89a5-4b08-9884-d0e761805dc4 None None] MFA Rules not processed for user `61521ea96a814dd0b1f88790c42c7049`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:26.165197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1308a734-89a5-4b08-9884-d0e761805dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:26.232145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1271/2528] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:26.243291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:26.244983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:26.298460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:26.302270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27f32-5b65-4793-a26f-840ed451221b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:26.306683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04020d6f-e2d4-456e-9f02-ce47318a5a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:26.307413 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04020d6f-e2d4-456e-9f02-ce47318a5a2f service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:26.307722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04020d6f-e2d4-456e-9f02-ce47318a5a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:26.307999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04020d6f-e2d4-456e-9f02-ce47318a5a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:26.316941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04020d6f-e2d4-456e-9f02-ce47318a5a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:26.318366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04020d6f-e2d4-456e-9f02-ce47318a5a2f service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:26.327635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1258/2529] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:27.674842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308a734-89a5-4b08-9884-d0e761805dc4 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:27.727050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:27.739204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308a734-89a5-4b08-9884-d0e761805dc4 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:27.743743 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:27.744709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:27.745047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:27.745387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] PATH_INFO: `/v3/users/8c2e4e6b49f94058a4a53a555e38be2e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:27.746645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2e4e6b49f94058a4a53a555e38be2e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:27.748671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:27.797645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2e4e6b49f94058a4a53a555e38be2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:27.810120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2e4e6b49f94058a4a53a555e38be2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:27.810909 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2e4e6b49f94058a4a53a555e38be2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:27.818461 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2e4e6b49f94058a4a53a555e38be2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:27.825814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2e4e6b49f94058a4a53a555e38be2e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:27.831724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1272/2530] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:27 2022] DELETE /identity/v3/users/8c2e4e6b49f94058a4a53a555e38be2e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:27.836334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1019d1-8e2d-4c48-9011-38ff6d1f8517 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:27.836792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1019d1-8e2d-4c48-9011-38ff6d1f8517 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:27.836952 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1019d1-8e2d-4c48-9011-38ff6d1f8517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:27.854537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fb1019d1-8e2d-4c48-9011-38ff6d1f8517 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:27.855793 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fb1019d1-8e2d-4c48-9011-38ff6d1f8517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:27.915823 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1259/2531] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:27.925536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:27.926941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:27.984357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a09562-5a8f-4365-87d6-98a7859bd480 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:27.988204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e842132-68a2-4076-a814-b043b05d64d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:27.988619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842132-68a2-4076-a814-b043b05d64d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:27.988885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842132-68a2-4076-a814-b043b05d64d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:27.989163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842132-68a2-4076-a814-b043b05d64d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:27.998989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e842132-68a2-4076-a814-b043b05d64d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:28.000561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e842132-68a2-4076-a814-b043b05d64d0 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:28.010796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1273/2532] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:28.264259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1019d1-8e2d-4c48-9011-38ff6d1f8517 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:28.265781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fb1019d1-8e2d-4c48-9011-38ff6d1f8517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:28.278940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1019d1-8e2d-4c48-9011-38ff6d1f8517 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:28.283640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:28.284676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:28.284904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:28.285189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] PATH_INFO: `/v3/projects/3647dba33160499b82f01cded370dc13` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:28.286376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3647dba33160499b82f01cded370dc13)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:28.288467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:28.333228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3647dba33160499b82f01cded370dc13', 'request_id': 'req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.340053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3647dba33160499b82f01cded370dc13', 'request_id': 'req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.345354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3647dba33160499b82f01cded370dc13', 'request_id': 'req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.356998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] The token cache is being invalidate because project 3647dba33160499b82f01cded370dc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:28.357291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.357948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.359511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1260/2533] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:28 2022] DELETE /identity/v3/projects/3647dba33160499b82f01cded370dc13 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:28.363420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e842132-68a2-4076-a814-b043b05d64d0 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:28.372896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e842132-68a2-4076-a814-b043b05d64d0 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:28.428235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:28.429108 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:28.429880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:28.430153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] PATH_INFO: `/v3/users/61521ea96a814dd0b1f88790c42c7049` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:28.431346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] RBAC: Authorizing `identity:delete_user(user_id=61521ea96a814dd0b1f88790c42c7049)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:28.433301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:28.448932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:28.478694 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61521ea96a814dd0b1f88790c42c7049'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.490671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61521ea96a814dd0b1f88790c42c7049'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.491356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61521ea96a814dd0b1f88790c42c7049'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.498039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61521ea96a814dd0b1f88790c42c7049'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.504830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-57015ee9-a699-40f7-8bd5-38dbfba2acce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61521ea96a814dd0b1f88790c42c7049'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.510708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1274/2534] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:28 2022] DELETE /identity/v3/users/61521ea96a814dd0b1f88790c42c7049 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:28.780898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:28.782453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:28.796578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd0cff-3d64-4d45-b564-7fda72c61f8f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:28.861070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:28.861956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:28.862243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:28.862529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] PATH_INFO: `/v3/projects/724abe6f978d42f6828cc44b1a4cee2d` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:28.863846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724abe6f978d42f6828cc44b1a4cee2d)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:28.865981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:28.884347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:28.916913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724abe6f978d42f6828cc44b1a4cee2d', 'request_id': 'req-5da62cb9-209c-474d-bd7d-8917d1e3ff18'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.923304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724abe6f978d42f6828cc44b1a4cee2d', 'request_id': 'req-5da62cb9-209c-474d-bd7d-8917d1e3ff18'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.929379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724abe6f978d42f6828cc44b1a4cee2d', 'request_id': 'req-5da62cb9-209c-474d-bd7d-8917d1e3ff18'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.942627 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] The token cache is being invalidate because project 724abe6f978d42f6828cc44b1a4cee2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:28.942952 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.943728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5da62cb9-209c-474d-bd7d-8917d1e3ff18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:28.945419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1261/2535] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:28 2022] DELETE /identity/v3/projects/724abe6f978d42f6828cc44b1a4cee2d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:28.950673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ff45-9722-4d28-afea-eb59833939d2 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:28.951220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ff45-9722-4d28-afea-eb59833939d2 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:28.951570 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ff45-9722-4d28-afea-eb59833939d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:28.970069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-3af7ff45-9722-4d28-afea-eb59833939d2 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:28.971289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-3af7ff45-9722-4d28-afea-eb59833939d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:29.030579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1275/2536] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:29.039420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df60c9-06e8-4c8e-88e4-0d474c625404 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.039801 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df60c9-06e8-4c8e-88e4-0d474c625404 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.040171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df60c9-06e8-4c8e-88e4-0d474c625404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.058668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d2df60c9-06e8-4c8e-88e4-0d474c625404 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:29.059904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d2df60c9-06e8-4c8e-88e4-0d474c625404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:29.068183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1262/2537] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:29.072872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ff45-9722-4d28-afea-eb59833939d2 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.082538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ff45-9722-4d28-afea-eb59833939d2 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.087830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.088487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.088773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.089050 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.089782 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:29.090094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.091772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.103098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1276/2538] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:29.107389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df60c9-06e8-4c8e-88e4-0d474c625404 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.116325 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df60c9-06e8-4c8e-88e4-0d474c625404 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.122706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a7df8-c188-48ae-bef6-a1bde5a07c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.123483 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a7df8-c188-48ae-bef6-a1bde5a07c52 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.123843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a7df8-c188-48ae-bef6-a1bde5a07c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.124196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a7df8-c188-48ae-bef6-a1bde5a07c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.124950 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a7df8-c188-48ae-bef6-a1bde5a07c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.127242 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a7df8-c188-48ae-bef6-a1bde5a07c52 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.156192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1263/2539] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:29 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:29.160145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.170219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053dc59-4224-4399-83b4-b99f42f679f0 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.225548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bd6b4-4689-4f1e-85f6-9eda08b68a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.226277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bd6b4-4689-4f1e-85f6-9eda08b68a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.226571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bd6b4-4689-4f1e-85f6-9eda08b68a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.226895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bd6b4-4689-4f1e-85f6-9eda08b68a4b admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.227596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bd6b4-4689-4f1e-85f6-9eda08b68a4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.229514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bd6b4-4689-4f1e-85f6-9eda08b68a4b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.252930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1277/2540] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:29 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:29.254221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a7df8-c188-48ae-bef6-a1bde5a07c52 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.265026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a7df8-c188-48ae-bef6-a1bde5a07c52 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.269718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f232d-cb53-4c1c-9ec8-be2cce436f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.270359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f232d-cb53-4c1c-9ec8-be2cce436f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.270645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f232d-cb53-4c1c-9ec8-be2cce436f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.270959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f232d-cb53-4c1c-9ec8-be2cce436f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.271818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f232d-cb53-4c1c-9ec8-be2cce436f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.273504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f232d-cb53-4c1c-9ec8-be2cce436f74 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.283816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1264/2541] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:29.287600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bd6b4-4689-4f1e-85f6-9eda08b68a4b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.297696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bd6b4-4689-4f1e-85f6-9eda08b68a4b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.302278 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122be6-4259-4890-9673-a3ab94f3248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.302966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122be6-4259-4890-9673-a3ab94f3248b admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.303260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122be6-4259-4890-9673-a3ab94f3248b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.303542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122be6-4259-4890-9673-a3ab94f3248b admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.304268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122be6-4259-4890-9673-a3ab94f3248b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.306351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122be6-4259-4890-9673-a3ab94f3248b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.311598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:29.317471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1278/2542] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:29.322106 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f232d-cb53-4c1c-9ec8-be2cce436f74 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.332109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f232d-cb53-4c1c-9ec8-be2cce436f74 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.337132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cec0-b7f6-443a-879c-acee47c56e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.338011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cec0-b7f6-443a-879c-acee47c56e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.338297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cec0-b7f6-443a-879c-acee47c56e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.338606 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cec0-b7f6-443a-879c-acee47c56e06 admin admin] PATH_INFO: `/v3/projects/143a3064145c42e0b06e2f6d270079b3/users/598129c82bc44a32a10b9e746b0880a9/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.353862 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18cec0-b7f6-443a-879c-acee47c56e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143a3064145c42e0b06e2f6d270079b3, user_id=598129c82bc44a32a10b9e746b0880a9, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.356618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18cec0-b7f6-443a-879c-acee47c56e06 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.369034 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1265/2543] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:29 2022] PUT /identity/v3/projects/143a3064145c42e0b06e2f6d270079b3/users/598129c82bc44a32a10b9e746b0880a9/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:29.379227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a468c-464b-4491-a6b9-95db28917c5f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.379550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a468c-464b-4491-a6b9-95db28917c5f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.379837 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a468c-464b-4491-a6b9-95db28917c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.406625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-8a3a468c-464b-4491-a6b9-95db28917c5f None None] MFA Rules not processed for user `598129c82bc44a32a10b9e746b0880a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:29.407868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8a3a468c-464b-4491-a6b9-95db28917c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:29.471353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1279/2544] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:29.475701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cec0-b7f6-443a-879c-acee47c56e06 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.535835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cec0-b7f6-443a-879c-acee47c56e06 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.540311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85060d5-1b6e-47e9-b587-0aa7f3ad1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.540968 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85060d5-1b6e-47e9-b587-0aa7f3ad1025 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.541258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85060d5-1b6e-47e9-b587-0aa7f3ad1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.541540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85060d5-1b6e-47e9-b587-0aa7f3ad1025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.542224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85060d5-1b6e-47e9-b587-0aa7f3ad1025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.544412 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85060d5-1b6e-47e9-b587-0aa7f3ad1025 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.568120 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1266/2545] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:29 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:29.572546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a468c-464b-4491-a6b9-95db28917c5f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.583199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a468c-464b-4491-a6b9-95db28917c5f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.638027 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269b1fc-c2e0-4a67-99b9-2c004a6aea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.638698 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269b1fc-c2e0-4a67-99b9-2c004a6aea59 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.639017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269b1fc-c2e0-4a67-99b9-2c004a6aea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.639302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269b1fc-c2e0-4a67-99b9-2c004a6aea59 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.639995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269b1fc-c2e0-4a67-99b9-2c004a6aea59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.641932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269b1fc-c2e0-4a67-99b9-2c004a6aea59 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.661523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1280/2546] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:29 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:29.665504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85060d5-1b6e-47e9-b587-0aa7f3ad1025 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.675707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85060d5-1b6e-47e9-b587-0aa7f3ad1025 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.680662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93099f30-1b0d-49ee-b53c-28dfe3c21102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.681316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099f30-1b0d-49ee-b53c-28dfe3c21102 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.681601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099f30-1b0d-49ee-b53c-28dfe3c21102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.681876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099f30-1b0d-49ee-b53c-28dfe3c21102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.682592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93099f30-1b0d-49ee-b53c-28dfe3c21102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.684210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93099f30-1b0d-49ee-b53c-28dfe3c21102 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.694404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1267/2547] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:29.698867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269b1fc-c2e0-4a67-99b9-2c004a6aea59 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.708709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269b1fc-c2e0-4a67-99b9-2c004a6aea59 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.713849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c3be-8fcc-42a4-a5fd-b27ea83db706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.714730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c3be-8fcc-42a4-a5fd-b27ea83db706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.715049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c3be-8fcc-42a4-a5fd-b27ea83db706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.715331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c3be-8fcc-42a4-a5fd-b27ea83db706 admin admin] PATH_INFO: `/v3/projects/65de9aef383549ea88c20e71ca851867/users/619fc588f55f40fcacd9a8616f7a59d6/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.729639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0c3be-8fcc-42a4-a5fd-b27ea83db706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65de9aef383549ea88c20e71ca851867, user_id=619fc588f55f40fcacd9a8616f7a59d6, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.732382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0c3be-8fcc-42a4-a5fd-b27ea83db706 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.744502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1281/2548] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:29 2022] PUT /identity/v3/projects/65de9aef383549ea88c20e71ca851867/users/619fc588f55f40fcacd9a8616f7a59d6/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:29.748397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93099f30-1b0d-49ee-b53c-28dfe3c21102 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.758509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93099f30-1b0d-49ee-b53c-28dfe3c21102 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.769656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:29.816285 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087995b9-c2c1-43fb-a747-cd74b35af803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.816888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087995b9-c2c1-43fb-a747-cd74b35af803 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.817185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087995b9-c2c1-43fb-a747-cd74b35af803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.817469 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087995b9-c2c1-43fb-a747-cd74b35af803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.818191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087995b9-c2c1-43fb-a747-cd74b35af803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.819813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087995b9-c2c1-43fb-a747-cd74b35af803 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.829261 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1268/2549] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:29.833435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c3be-8fcc-42a4-a5fd-b27ea83db706 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.844081 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c3be-8fcc-42a4-a5fd-b27ea83db706 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.848701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.849592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.849880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.850160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] PATH_INFO: `/v3/projects/65de9aef383549ea88c20e71ca851867/users/619fc588f55f40fcacd9a8616f7a59d6/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.852683 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65de9aef383549ea88c20e71ca851867, user_id=619fc588f55f40fcacd9a8616f7a59d6, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.855365 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.865369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1282/2550] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:29 2022] PUT /identity/v3/projects/65de9aef383549ea88c20e71ca851867/users/619fc588f55f40fcacd9a8616f7a59d6/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:29.875967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265462a1-f04f-4e4e-8067-679a9695edd6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.876430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265462a1-f04f-4e4e-8067-679a9695edd6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.876541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265462a1-f04f-4e4e-8067-679a9695edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.902875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-265462a1-f04f-4e4e-8067-679a9695edd6 None None] MFA Rules not processed for user `619fc588f55f40fcacd9a8616f7a59d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:29.904064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-265462a1-f04f-4e4e-8067-679a9695edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:29.971137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1269/2551] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:29.982075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.983827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:30.031005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:30.044321 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc033-9c28-4738-8a09-472a474cbba2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:30.048164 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff422c6-479f-4f86-8be4-d67613ab8ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:30.048820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff422c6-479f-4f86-8be4-d67613ab8ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.049105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff422c6-479f-4f86-8be4-d67613ab8ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.049378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff422c6-479f-4f86-8be4-d67613ab8ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.059947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff422c6-479f-4f86-8be4-d67613ab8ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:30.061435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff422c6-479f-4f86-8be4-d67613ab8ab4 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:30.072810 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1283/2552] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:30.099150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265462a1-f04f-4e4e-8067-679a9695edd6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:30.160898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265462a1-f04f-4e4e-8067-679a9695edd6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:30.165415 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:30.166286 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.166573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.166887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] PATH_INFO: `/v3/users/598129c82bc44a32a10b9e746b0880a9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.168067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=598129c82bc44a32a10b9e746b0880a9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:30.170225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:30.210460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:30.216748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598129c82bc44a32a10b9e746b0880a9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.217432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598129c82bc44a32a10b9e746b0880a9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.224102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598129c82bc44a32a10b9e746b0880a9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.230884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598129c82bc44a32a10b9e746b0880a9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.242749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598129c82bc44a32a10b9e746b0880a9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.248544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1270/2553] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:30 2022] DELETE /identity/v3/users/598129c82bc44a32a10b9e746b0880a9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:30.253096 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd9b80-913d-4914-81fe-69f93cf9b14d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.253399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd9b80-913d-4914-81fe-69f93cf9b14d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.253688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd9b80-913d-4914-81fe-69f93cf9b14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.271829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-23bd9b80-913d-4914-81fe-69f93cf9b14d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:30.273046 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-23bd9b80-913d-4914-81fe-69f93cf9b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:30.331013 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1284/2554] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:30.341009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:30.342394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:30.397816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d836e7-b538-4bd5-bb30-05a1ec0bf35d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:30.402089 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6f3a-bc41-4651-a416-7b8242b5a450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:30.402742 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6f3a-bc41-4651-a416-7b8242b5a450 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.403067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6f3a-bc41-4651-a416-7b8242b5a450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.403353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6f3a-bc41-4651-a416-7b8242b5a450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.412303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d6f3a-bc41-4651-a416-7b8242b5a450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:30.413762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d6f3a-bc41-4651-a416-7b8242b5a450 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:30.423659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1271/2555] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:30.691800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd9b80-913d-4914-81fe-69f93cf9b14d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:30.693261 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-23bd9b80-913d-4914-81fe-69f93cf9b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:30.705070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd9b80-913d-4914-81fe-69f93cf9b14d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:30.709780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:30.711165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.711465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.711742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] PATH_INFO: `/v3/projects/143a3064145c42e0b06e2f6d270079b3` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.713008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=143a3064145c42e0b06e2f6d270079b3)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:30.714974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:30.760963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143a3064145c42e0b06e2f6d270079b3', 'request_id': 'req-8e2b5871-1580-47a1-b990-a53d75dab70c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.766465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143a3064145c42e0b06e2f6d270079b3', 'request_id': 'req-8e2b5871-1580-47a1-b990-a53d75dab70c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.772431 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143a3064145c42e0b06e2f6d270079b3', 'request_id': 'req-8e2b5871-1580-47a1-b990-a53d75dab70c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.786057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] The token cache is being invalidate because project 143a3064145c42e0b06e2f6d270079b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:30.786351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.787015 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.788751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1285/2556] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:30 2022] DELETE /identity/v3/projects/143a3064145c42e0b06e2f6d270079b3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:30.793646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6f3a-bc41-4651-a416-7b8242b5a450 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:30.803294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6f3a-bc41-4651-a416-7b8242b5a450 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:30.860313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:30.861841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.862359 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.863001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] PATH_INFO: `/v3/users/619fc588f55f40fcacd9a8616f7a59d6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.865093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619fc588f55f40fcacd9a8616f7a59d6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:30.868904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:30.923463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619fc588f55f40fcacd9a8616f7a59d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.924115 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619fc588f55f40fcacd9a8616f7a59d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.931324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619fc588f55f40fcacd9a8616f7a59d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.936623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:30.939189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619fc588f55f40fcacd9a8616f7a59d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.953859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-289d1dad-4c93-435a-96d5-53b747657253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619fc588f55f40fcacd9a8616f7a59d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:30.960393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1272/2557] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:30 2022] DELETE /identity/v3/users/619fc588f55f40fcacd9a8616f7a59d6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:31.240327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:31.241825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:31.255455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5871-1580-47a1-b990-a53d75dab70c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:31.319437 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:31.320453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.320739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.321016 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] PATH_INFO: `/v3/projects/65de9aef383549ea88c20e71ca851867` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.322198 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] RBAC: Authorizing `identity:delete_project(project_id=65de9aef383549ea88c20e71ca851867)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:31.324169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:31.334236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:31.371088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65de9aef383549ea88c20e71ca851867', 'request_id': 'req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:31.376583 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65de9aef383549ea88c20e71ca851867', 'request_id': 'req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:31.382571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65de9aef383549ea88c20e71ca851867', 'request_id': 'req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:31.395006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] The token cache is being invalidate because project 65de9aef383549ea88c20e71ca851867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:31.395297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:31.395914 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-a39f948a-f85d-4fff-bcf3-9b7ede91bdee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:31.397415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1286/2558] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:31 2022] DELETE /identity/v3/projects/65de9aef383549ea88c20e71ca851867 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:31.403038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc693-0f52-4d71-a510-c17c4119de4d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.403350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc693-0f52-4d71-a510-c17c4119de4d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.403616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc693-0f52-4d71-a510-c17c4119de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.421943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9b2dc693-0f52-4d71-a510-c17c4119de4d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:31.423169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9b2dc693-0f52-4d71-a510-c17c4119de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:31.479546 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1273/2559] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:31.488345 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455427e-9b8e-44cd-a3d4-97e5de824883 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.488643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455427e-9b8e-44cd-a3d4-97e5de824883 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.488929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455427e-9b8e-44cd-a3d4-97e5de824883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.507248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e455427e-9b8e-44cd-a3d4-97e5de824883 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:31.509058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e455427e-9b8e-44cd-a3d4-97e5de824883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:31.516889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1287/2560] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:31.521058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dc693-0f52-4d71-a510-c17c4119de4d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:31.531161 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dc693-0f52-4d71-a510-c17c4119de4d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:31.535686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:31.536346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.536635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.536915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.537638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:31.537949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:31.540123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:31.551700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1274/2561] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:31.555807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455427e-9b8e-44cd-a3d4-97e5de824883 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:31.564807 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455427e-9b8e-44cd-a3d4-97e5de824883 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:31.569384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886acd6b-614b-4ccb-a0d1-c2e585b2b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:31.570031 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886acd6b-614b-4ccb-a0d1-c2e585b2b0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.570318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886acd6b-614b-4ccb-a0d1-c2e585b2b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.570598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886acd6b-614b-4ccb-a0d1-c2e585b2b0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.571325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886acd6b-614b-4ccb-a0d1-c2e585b2b0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:31.573207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886acd6b-614b-4ccb-a0d1-c2e585b2b0a3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:31.597873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1288/2562] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:31 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:39:31.602482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:31.612304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07d2a-8ffc-49db-9297-bc0216d20ea2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:31.667644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad5ee-ddba-4db6-85d8-9bf1913d85f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:31.668564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad5ee-ddba-4db6-85d8-9bf1913d85f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.668863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad5ee-ddba-4db6-85d8-9bf1913d85f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.669144 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad5ee-ddba-4db6-85d8-9bf1913d85f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.669835 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad5ee-ddba-4db6-85d8-9bf1913d85f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:31.671790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad5ee-ddba-4db6-85d8-9bf1913d85f3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:31.690153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1275/2563] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:31 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:39:31.694161 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886acd6b-614b-4ccb-a0d1-c2e585b2b0a3 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:31.706017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886acd6b-614b-4ccb-a0d1-c2e585b2b0a3 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:31.710465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d932db2-1520-4f78-912c-9d44db99600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:31.711655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d932db2-1520-4f78-912c-9d44db99600b admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.711938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d932db2-1520-4f78-912c-9d44db99600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.712213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d932db2-1520-4f78-912c-9d44db99600b admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.712932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d932db2-1520-4f78-912c-9d44db99600b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:31.714526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d932db2-1520-4f78-912c-9d44db99600b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:31.724641 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1289/2564] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:31.728960 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad5ee-ddba-4db6-85d8-9bf1913d85f3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:31.738811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad5ee-ddba-4db6-85d8-9bf1913d85f3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:31.743403 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f5c59-b9a0-49de-8a8d-8c78a050e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:31.744087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5c59-b9a0-49de-8a8d-8c78a050e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.744376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5c59-b9a0-49de-8a8d-8c78a050e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.744658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5c59-b9a0-49de-8a8d-8c78a050e4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.745407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f5c59-b9a0-49de-8a8d-8c78a050e4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:31.747017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f5c59-b9a0-49de-8a8d-8c78a050e4ae admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:31.756863 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1276/2565] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:31.761368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d932db2-1520-4f78-912c-9d44db99600b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:31.771253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d932db2-1520-4f78-912c-9d44db99600b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:31.776466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2b9c8-d195-4adc-a599-034eb2c0dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:31.777341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2b9c8-d195-4adc-a599-034eb2c0dfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.777626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2b9c8-d195-4adc-a599-034eb2c0dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.777903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2b9c8-d195-4adc-a599-034eb2c0dfd2 admin admin] PATH_INFO: `/v3/projects/15f958e61302495bb68cfb0761fca56c/users/7c4d6e52bedc410e84656a624721f64c/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.792056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2b9c8-d195-4adc-a599-034eb2c0dfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f958e61302495bb68cfb0761fca56c, user_id=7c4d6e52bedc410e84656a624721f64c, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:31.794973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2b9c8-d195-4adc-a599-034eb2c0dfd2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:31.808106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1290/2566] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:31 2022] PUT /identity/v3/projects/15f958e61302495bb68cfb0761fca56c/users/7c4d6e52bedc410e84656a624721f64c/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:31.818539 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96383-f1e9-4f54-8876-75aa9518e6a4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.818875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96383-f1e9-4f54-8876-75aa9518e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.819148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96383-f1e9-4f54-8876-75aa9518e6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.845913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-43a96383-f1e9-4f54-8876-75aa9518e6a4 None None] MFA Rules not processed for user `7c4d6e52bedc410e84656a624721f64c`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:31.847180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-43a96383-f1e9-4f54-8876-75aa9518e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:31.878320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:31.912436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1277/2567] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:31.917079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2b9c8-d195-4adc-a599-034eb2c0dfd2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:31.978141 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2b9c8-d195-4adc-a599-034eb2c0dfd2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:31.982714 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878ad24-9990-41a9-a7d2-7838885b5d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:31.983406 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878ad24-9990-41a9-a7d2-7838885b5d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.983695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878ad24-9990-41a9-a7d2-7838885b5d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.983976 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878ad24-9990-41a9-a7d2-7838885b5d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.984664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878ad24-9990-41a9-a7d2-7838885b5d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:31.986581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878ad24-9990-41a9-a7d2-7838885b5d70 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.010748 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1291/2568] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:31 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:32.015216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96383-f1e9-4f54-8876-75aa9518e6a4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.026741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96383-f1e9-4f54-8876-75aa9518e6a4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.080934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d5ba-798e-41d9-ad6e-f65859b9b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.081616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d5ba-798e-41d9-ad6e-f65859b9b1db admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.081908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d5ba-798e-41d9-ad6e-f65859b9b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.082191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d5ba-798e-41d9-ad6e-f65859b9b1db admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.082931 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017d5ba-798e-41d9-ad6e-f65859b9b1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.084833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017d5ba-798e-41d9-ad6e-f65859b9b1db admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.104569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1278/2569] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:32 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:32.108520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878ad24-9990-41a9-a7d2-7838885b5d70 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.119241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878ad24-9990-41a9-a7d2-7838885b5d70 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.123773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22aa4-d577-4475-a632-588b0102d7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.124434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22aa4-d577-4475-a632-588b0102d7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.124724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22aa4-d577-4475-a632-588b0102d7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.125007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22aa4-d577-4475-a632-588b0102d7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.125738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d22aa4-d577-4475-a632-588b0102d7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.127384 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d22aa4-d577-4475-a632-588b0102d7c4 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.138188 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1292/2570] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:32.141775 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d5ba-798e-41d9-ad6e-f65859b9b1db admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.152258 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d5ba-798e-41d9-ad6e-f65859b9b1db admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.156741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038e967-cc16-4310-bc3e-5ce1ed8bf709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.157397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038e967-cc16-4310-bc3e-5ce1ed8bf709 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.157681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038e967-cc16-4310-bc3e-5ce1ed8bf709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.157982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038e967-cc16-4310-bc3e-5ce1ed8bf709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.158722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038e967-cc16-4310-bc3e-5ce1ed8bf709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.160306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038e967-cc16-4310-bc3e-5ce1ed8bf709 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.170294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1279/2571] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:32.174182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22aa4-d577-4475-a632-588b0102d7c4 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.184752 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22aa4-d577-4475-a632-588b0102d7c4 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.189708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47fc5-151d-4944-8eda-2fd49fed86e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.190610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47fc5-151d-4944-8eda-2fd49fed86e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.190936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47fc5-151d-4944-8eda-2fd49fed86e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.191225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47fc5-151d-4944-8eda-2fd49fed86e8 admin admin] PATH_INFO: `/v3/projects/af38fbf9692943eebb70480fdc469ea5/users/4161a1be6e9f49329cfe7cd464517592/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.194491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:32.210181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d47fc5-151d-4944-8eda-2fd49fed86e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af38fbf9692943eebb70480fdc469ea5, user_id=4161a1be6e9f49329cfe7cd464517592, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.212946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d47fc5-151d-4944-8eda-2fd49fed86e8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.225502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1293/2572] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:32 2022] PUT /identity/v3/projects/af38fbf9692943eebb70480fdc469ea5/users/4161a1be6e9f49329cfe7cd464517592/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:32.236730 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd3c96-4594-4d1d-a144-142144b42525 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.236954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd3c96-4594-4d1d-a144-142144b42525 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.237237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd3c96-4594-4d1d-a144-142144b42525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.265134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-43dd3c96-4594-4d1d-a144-142144b42525 None None] MFA Rules not processed for user `4161a1be6e9f49329cfe7cd464517592`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:32.266369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-43dd3c96-4594-4d1d-a144-142144b42525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:32.341278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1280/2573] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:32.345618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47fc5-151d-4944-8eda-2fd49fed86e8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.411540 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47fc5-151d-4944-8eda-2fd49fed86e8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.416984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81328e6-52d9-4ac4-bb8a-4435fd306637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.417652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81328e6-52d9-4ac4-bb8a-4435fd306637 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.417937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81328e6-52d9-4ac4-bb8a-4435fd306637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.418212 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81328e6-52d9-4ac4-bb8a-4435fd306637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.419229 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81328e6-52d9-4ac4-bb8a-4435fd306637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.421159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81328e6-52d9-4ac4-bb8a-4435fd306637 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.447918 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1294/2574] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:32 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:32.451859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd3c96-4594-4d1d-a144-142144b42525 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.463424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd3c96-4594-4d1d-a144-142144b42525 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.504133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:32.522011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937227b-55b4-475b-bcc0-1a7bb3961669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.522693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937227b-55b4-475b-bcc0-1a7bb3961669 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.523090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937227b-55b4-475b-bcc0-1a7bb3961669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.523399 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937227b-55b4-475b-bcc0-1a7bb3961669 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.524103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937227b-55b4-475b-bcc0-1a7bb3961669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.526002 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937227b-55b4-475b-bcc0-1a7bb3961669 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.549505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1281/2575] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:32 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:32.550562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81328e6-52d9-4ac4-bb8a-4435fd306637 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.561452 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81328e6-52d9-4ac4-bb8a-4435fd306637 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.580848 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d463-869c-4dd6-8c17-d20d50b8acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.581531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d463-869c-4dd6-8c17-d20d50b8acc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.581817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d463-869c-4dd6-8c17-d20d50b8acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.582097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d463-869c-4dd6-8c17-d20d50b8acc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.582857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854d463-869c-4dd6-8c17-d20d50b8acc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.584477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854d463-869c-4dd6-8c17-d20d50b8acc9 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.597311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1295/2576] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:32.602981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937227b-55b4-475b-bcc0-1a7bb3961669 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.613216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937227b-55b4-475b-bcc0-1a7bb3961669 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.620067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94506723-cbf6-4035-830b-88f1144e7f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.621032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94506723-cbf6-4035-830b-88f1144e7f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.621322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94506723-cbf6-4035-830b-88f1144e7f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.621599 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94506723-cbf6-4035-830b-88f1144e7f86 admin admin] PATH_INFO: `/v3/projects/9edcb2db1a994ec2a2edcd9767029da1/users/cb1eb47b0d4e4d7aa16b51587c536555/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.640303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94506723-cbf6-4035-830b-88f1144e7f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edcb2db1a994ec2a2edcd9767029da1, user_id=cb1eb47b0d4e4d7aa16b51587c536555, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.643973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94506723-cbf6-4035-830b-88f1144e7f86 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.657518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1282/2577] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:32 2022] PUT /identity/v3/projects/9edcb2db1a994ec2a2edcd9767029da1/users/cb1eb47b0d4e4d7aa16b51587c536555/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:32.661666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d463-869c-4dd6-8c17-d20d50b8acc9 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.673448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d463-869c-4dd6-8c17-d20d50b8acc9 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.735854 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ea689-26ec-4332-87ee-47d37e848335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.736544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea689-26ec-4332-87ee-47d37e848335 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.736832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea689-26ec-4332-87ee-47d37e848335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.737120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea689-26ec-4332-87ee-47d37e848335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.737853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ea689-26ec-4332-87ee-47d37e848335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.739530 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ea689-26ec-4332-87ee-47d37e848335 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.750414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1296/2578] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:32.754826 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94506723-cbf6-4035-830b-88f1144e7f86 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.765895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94506723-cbf6-4035-830b-88f1144e7f86 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:32.771156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:32.772201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.772583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.772967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] PATH_INFO: `/v3/projects/9edcb2db1a994ec2a2edcd9767029da1/users/cb1eb47b0d4e4d7aa16b51587c536555/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.781420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edcb2db1a994ec2a2edcd9767029da1, user_id=cb1eb47b0d4e4d7aa16b51587c536555, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:32.784124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:32.795748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1283/2579] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:32 2022] PUT /identity/v3/projects/9edcb2db1a994ec2a2edcd9767029da1/users/cb1eb47b0d4e4d7aa16b51587c536555/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:32.861591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddc924-6670-4d34-9d61-46b97bd71172 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:32.862269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddc924-6670-4d34-9d61-46b97bd71172 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:32.862558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddc924-6670-4d34-9d61-46b97bd71172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:32.890558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-9dddc924-6670-4d34-9d61-46b97bd71172 None None] MFA Rules not processed for user `cb1eb47b0d4e4d7aa16b51587c536555`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:32.891836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9dddc924-6670-4d34-9d61-46b97bd71172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:32.938280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:32.966114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1297/2580] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:32.977346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:32.979047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:33.036527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2767f9-d572-4f69-8693-4fe95ed63750 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:33.040821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e35b-adf4-4a2b-a139-8136fc3ce712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:33.041482 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e35b-adf4-4a2b-a139-8136fc3ce712 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:33.041771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e35b-adf4-4a2b-a139-8136fc3ce712 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:33.042054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e35b-adf4-4a2b-a139-8136fc3ce712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:33.056596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13e35b-adf4-4a2b-a139-8136fc3ce712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:33.058113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13e35b-adf4-4a2b-a139-8136fc3ce712 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:33.068552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1284/2581] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:33.551619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddc924-6670-4d34-9d61-46b97bd71172 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:33.553051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9dddc924-6670-4d34-9d61-46b97bd71172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:33.564803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddc924-6670-4d34-9d61-46b97bd71172 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:33.568319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5ba1-e4f2-4e0b-b9cf-821255597e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:33.568965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5ba1-e4f2-4e0b-b9cf-821255597e83 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:33.569249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5ba1-e4f2-4e0b-b9cf-821255597e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:33.569533 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5ba1-e4f2-4e0b-b9cf-821255597e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:33.624594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf5ba1-e4f2-4e0b-b9cf-821255597e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:33.626037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf5ba1-e4f2-4e0b-b9cf-821255597e83 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:33.635389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1298/2582] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:37.588814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e35b-adf4-4a2b-a139-8136fc3ce712 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:37.597423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e35b-adf4-4a2b-a139-8136fc3ce712 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:37.601010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeabb09-57fb-4fca-975d-b754cc8dfe79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:37.601648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeabb09-57fb-4fca-975d-b754cc8dfe79 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:37.601937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeabb09-57fb-4fca-975d-b754cc8dfe79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:37.602220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeabb09-57fb-4fca-975d-b754cc8dfe79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:37.658215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeabb09-57fb-4fca-975d-b754cc8dfe79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:37.659610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeabb09-57fb-4fca-975d-b754cc8dfe79 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:37.669273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1285/2583] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:39.679106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5ba1-e4f2-4e0b-b9cf-821255597e83 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:39.739760 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5ba1-e4f2-4e0b-b9cf-821255597e83 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:39.744687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:39.745560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:39.745844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:39.746122 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] PATH_INFO: `/v3/users/7c4d6e52bedc410e84656a624721f64c` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:39.747318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4d6e52bedc410e84656a624721f64c)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:39.749277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:39.797158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4d6e52bedc410e84656a624721f64c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:39.809300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4d6e52bedc410e84656a624721f64c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:39.809904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4d6e52bedc410e84656a624721f64c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:39.816688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4d6e52bedc410e84656a624721f64c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:39.824295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4d6e52bedc410e84656a624721f64c'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:39.825696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:39.831636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1299/2584] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:39 2022] DELETE /identity/v3/users/7c4d6e52bedc410e84656a624721f64c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:39.836201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0cfc9-4f82-4e0a-ac52-becf613ef1c8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:39.836687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0cfc9-4f82-4e0a-ac52-becf613ef1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:39.836795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0cfc9-4f82-4e0a-ac52-becf613ef1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:39.854882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7cf0cfc9-4f82-4e0a-ac52-becf613ef1c8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:39.856066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7cf0cfc9-4f82-4e0a-ac52-becf613ef1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:39.885019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:39.914058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1286/2585] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:39.924509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:39.925890 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:39.981433 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa26c6-837a-4659-8005-fd60d7670984 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:39.985038 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818c791-157e-4379-9c5c-74e115ac0e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:39.985682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c791-157e-4379-9c5c-74e115ac0e34 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:39.985967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c791-157e-4379-9c5c-74e115ac0e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:39.986245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c791-157e-4379-9c5c-74e115ac0e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:39.995047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818c791-157e-4379-9c5c-74e115ac0e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:39.996483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818c791-157e-4379-9c5c-74e115ac0e34 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:40.005725 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1300/2586] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:40.270904 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0cfc9-4f82-4e0a-ac52-becf613ef1c8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:40.272448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7cf0cfc9-4f82-4e0a-ac52-becf613ef1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:40.290645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0cfc9-4f82-4e0a-ac52-becf613ef1c8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:40.296045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:40.297588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:40.297940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:40.298154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] PATH_INFO: `/v3/projects/15f958e61302495bb68cfb0761fca56c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:40.299613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f958e61302495bb68cfb0761fca56c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:40.301760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:40.353400 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f958e61302495bb68cfb0761fca56c', 'request_id': 'req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.360477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f958e61302495bb68cfb0761fca56c', 'request_id': 'req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.367232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f958e61302495bb68cfb0761fca56c', 'request_id': 'req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.380156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] The token cache is being invalidate because project 15f958e61302495bb68cfb0761fca56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:40.380454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.381121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.382704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1287/2587] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:40 2022] DELETE /identity/v3/projects/15f958e61302495bb68cfb0761fca56c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:40.386821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818c791-157e-4379-9c5c-74e115ac0e34 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:40.396362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818c791-157e-4379-9c5c-74e115ac0e34 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:40.452329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:40.453207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:40.453502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:40.453803 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] PATH_INFO: `/v3/users/4161a1be6e9f49329cfe7cd464517592` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:40.455022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4161a1be6e9f49329cfe7cd464517592)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:40.456975 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:40.502838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4161a1be6e9f49329cfe7cd464517592'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.515295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4161a1be6e9f49329cfe7cd464517592'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.515968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4161a1be6e9f49329cfe7cd464517592'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.522790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4161a1be6e9f49329cfe7cd464517592'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.529512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4161a1be6e9f49329cfe7cd464517592'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.535444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1301/2588] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:40 2022] DELETE /identity/v3/users/4161a1be6e9f49329cfe7cd464517592 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:40.800795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:40.802299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:40.816223 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8a8b-b7ea-4e9f-a271-b26ac116b2ce admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:40.877569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:40.879135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:40.880783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:40.881074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] PATH_INFO: `/v3/projects/af38fbf9692943eebb70480fdc469ea5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:40.882308 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af38fbf9692943eebb70480fdc469ea5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:40.884291 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:40.931647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af38fbf9692943eebb70480fdc469ea5', 'request_id': 'req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.937919 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af38fbf9692943eebb70480fdc469ea5', 'request_id': 'req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.942959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:40.944426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af38fbf9692943eebb70480fdc469ea5', 'request_id': 'req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.957699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] The token cache is being invalidate because project af38fbf9692943eebb70480fdc469ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:40.957996 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.958643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:40.960220 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1288/2589] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:40 2022] DELETE /identity/v3/projects/af38fbf9692943eebb70480fdc469ea5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:40.964352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:40.965812 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:40.978912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea85bce-b777-401d-af5a-3b4d7b8a997c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:40.996301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:41.039906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:41.041972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:41.042263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:41.042670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] PATH_INFO: `/v3/users/cb1eb47b0d4e4d7aa16b51587c536555` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:41.044324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1eb47b0d4e4d7aa16b51587c536555)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:41.046576 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:41.112472 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1eb47b0d4e4d7aa16b51587c536555'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.127717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1eb47b0d4e4d7aa16b51587c536555'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.128361 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1eb47b0d4e4d7aa16b51587c536555'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.135872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1eb47b0d4e4d7aa16b51587c536555'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.143460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-601e4d0d-46c6-422a-b4ff-d2123b2d6e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1eb47b0d4e4d7aa16b51587c536555'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.151033 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1302/2590] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:40 2022] DELETE /identity/v3/users/cb1eb47b0d4e4d7aa16b51587c536555 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:41.667368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:41.670045 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:41.686918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e0a84-8be8-4fe2-b0d2-752bd92f2182 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:41.780228 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:41.781977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:41.782275 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:41.782564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] PATH_INFO: `/v3/projects/9edcb2db1a994ec2a2edcd9767029da1` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:41.783925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edcb2db1a994ec2a2edcd9767029da1)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:41.786053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:41.837134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edcb2db1a994ec2a2edcd9767029da1', 'request_id': 'req-5117e12d-6351-4084-8d8c-e123843dceb7'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.843241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edcb2db1a994ec2a2edcd9767029da1', 'request_id': 'req-5117e12d-6351-4084-8d8c-e123843dceb7'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.848914 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edcb2db1a994ec2a2edcd9767029da1', 'request_id': 'req-5117e12d-6351-4084-8d8c-e123843dceb7'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.862322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] The token cache is being invalidate because project 9edcb2db1a994ec2a2edcd9767029da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:41.862573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.863216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5117e12d-6351-4084-8d8c-e123843dceb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:41.864890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1289/2591] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:41 2022] DELETE /identity/v3/projects/9edcb2db1a994ec2a2edcd9767029da1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:41.871487 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624fb3-3fc8-446c-98d2-2506e7c88e2e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:41.871859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624fb3-3fc8-446c-98d2-2506e7c88e2e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:41.872286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624fb3-3fc8-446c-98d2-2506e7c88e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.013973 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-7a624fb3-3fc8-446c-98d2-2506e7c88e2e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:42.015386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7a624fb3-3fc8-446c-98d2-2506e7c88e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:42.083236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1303/2592] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:42.092132 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64db7-84db-4920-9076-eb8427cf6881 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.092679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64db7-84db-4920-9076-eb8427cf6881 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.092830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64db7-84db-4920-9076-eb8427cf6881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.120712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ede64db7-84db-4920-9076-eb8427cf6881 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:42.122040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ede64db7-84db-4920-9076-eb8427cf6881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:42.130388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1290/2593] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:42.135492 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a624fb3-3fc8-446c-98d2-2506e7c88e2e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.150793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a624fb3-3fc8-446c-98d2-2506e7c88e2e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.156516 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.157392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.157667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.158095 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.158995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:42.159470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.161540 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.175546 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1304/2594] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:42.179816 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64db7-84db-4920-9076-eb8427cf6881 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.189938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64db7-84db-4920-9076-eb8427cf6881 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.196273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c968e-f8b4-4b66-a672-466a91bc77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.197864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c968e-f8b4-4b66-a672-466a91bc77d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.198812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c968e-f8b4-4b66-a672-466a91bc77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.198812 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c968e-f8b4-4b66-a672-466a91bc77d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.199442 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c968e-f8b4-4b66-a672-466a91bc77d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.201731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c968e-f8b4-4b66-a672-466a91bc77d6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.227672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1291/2595] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:42 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:39:42.232154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.244030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356b0fc-fb22-4db8-893d-ca585522444e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.269967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:42.307291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc61884-fed4-45cd-a240-9f349698e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.307878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc61884-fed4-45cd-a240-9f349698e1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.308169 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc61884-fed4-45cd-a240-9f349698e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.308453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc61884-fed4-45cd-a240-9f349698e1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.309148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc61884-fed4-45cd-a240-9f349698e1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.311111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc61884-fed4-45cd-a240-9f349698e1d1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.331049 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1305/2596] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:42 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:39:42.334966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c968e-f8b4-4b66-a672-466a91bc77d6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.345564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c968e-f8b4-4b66-a672-466a91bc77d6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.350260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417495ee-6bb3-43bb-b96f-13dc79e013a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.350977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417495ee-6bb3-43bb-b96f-13dc79e013a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.351264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417495ee-6bb3-43bb-b96f-13dc79e013a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.351544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417495ee-6bb3-43bb-b96f-13dc79e013a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.352307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417495ee-6bb3-43bb-b96f-13dc79e013a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.354556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417495ee-6bb3-43bb-b96f-13dc79e013a1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.365497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1292/2597] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:42.370213 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc61884-fed4-45cd-a240-9f349698e1d1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.380610 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc61884-fed4-45cd-a240-9f349698e1d1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.385726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73a89a-0b5b-4d9f-9652-19a023adfa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.386407 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73a89a-0b5b-4d9f-9652-19a023adfa8c admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.386693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73a89a-0b5b-4d9f-9652-19a023adfa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.387026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73a89a-0b5b-4d9f-9652-19a023adfa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.387768 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73a89a-0b5b-4d9f-9652-19a023adfa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.389389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73a89a-0b5b-4d9f-9652-19a023adfa8c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.400005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1306/2598] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:42.404313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417495ee-6bb3-43bb-b96f-13dc79e013a1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.414634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417495ee-6bb3-43bb-b96f-13dc79e013a1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.420134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149d3b-0dc3-42d1-b4fb-5b0012fe0aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.421031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149d3b-0dc3-42d1-b4fb-5b0012fe0aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.421318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149d3b-0dc3-42d1-b4fb-5b0012fe0aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.421601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149d3b-0dc3-42d1-b4fb-5b0012fe0aa2 admin admin] PATH_INFO: `/v3/projects/212cac5ca2f64cdb8d2d93c5a173b0fa/users/4e3189bb35e94d459e8b9a0207fe40e2/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.438510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149d3b-0dc3-42d1-b4fb-5b0012fe0aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212cac5ca2f64cdb8d2d93c5a173b0fa, user_id=4e3189bb35e94d459e8b9a0207fe40e2, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.441266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149d3b-0dc3-42d1-b4fb-5b0012fe0aa2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.457014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1293/2599] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:42 2022] PUT /identity/v3/projects/212cac5ca2f64cdb8d2d93c5a173b0fa/users/4e3189bb35e94d459e8b9a0207fe40e2/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:42.468704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c415f-50d1-4827-9fbe-4512a47f4a11 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.469150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c415f-50d1-4827-9fbe-4512a47f4a11 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.469464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c415f-50d1-4827-9fbe-4512a47f4a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.497147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-db6c415f-50d1-4827-9fbe-4512a47f4a11 None None] MFA Rules not processed for user `4e3189bb35e94d459e8b9a0207fe40e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:42.498366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-db6c415f-50d1-4827-9fbe-4512a47f4a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:42.584144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1307/2600] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:42.588970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149d3b-0dc3-42d1-b4fb-5b0012fe0aa2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.609881 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:42.662628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149d3b-0dc3-42d1-b4fb-5b0012fe0aa2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.668061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f37db-1c8c-451c-9f12-26fcd817e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.668732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f37db-1c8c-451c-9f12-26fcd817e0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.669283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f37db-1c8c-451c-9f12-26fcd817e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.669584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f37db-1c8c-451c-9f12-26fcd817e0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.670296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f37db-1c8c-451c-9f12-26fcd817e0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.672260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f37db-1c8c-451c-9f12-26fcd817e0d2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.699103 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1294/2601] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:42 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:42.702991 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c415f-50d1-4827-9fbe-4512a47f4a11 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.714828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c415f-50d1-4827-9fbe-4512a47f4a11 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.789548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368b4bc-999b-42de-9675-b4f3bd297633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.790448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b4bc-999b-42de-9675-b4f3bd297633 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.790831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b4bc-999b-42de-9675-b4f3bd297633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.791181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b4bc-999b-42de-9675-b4f3bd297633 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.792214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368b4bc-999b-42de-9675-b4f3bd297633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.795294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368b4bc-999b-42de-9675-b4f3bd297633 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.816330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1308/2602] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:42 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:42.820214 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f37db-1c8c-451c-9f12-26fcd817e0d2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.831108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f37db-1c8c-451c-9f12-26fcd817e0d2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.835676 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad7e5-7143-4fb8-852e-e3840242ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.836340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad7e5-7143-4fb8-852e-e3840242ffc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.836632 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad7e5-7143-4fb8-852e-e3840242ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.836911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad7e5-7143-4fb8-852e-e3840242ffc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.837665 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fad7e5-7143-4fb8-852e-e3840242ffc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.839284 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fad7e5-7143-4fb8-852e-e3840242ffc2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.849927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1295/2603] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:42.854166 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368b4bc-999b-42de-9675-b4f3bd297633 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.864543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368b4bc-999b-42de-9675-b4f3bd297633 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.869966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34295d-e332-48a0-83aa-4469bb372aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.870733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34295d-e332-48a0-83aa-4469bb372aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.871633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34295d-e332-48a0-83aa-4469bb372aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.871633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34295d-e332-48a0-83aa-4469bb372aa1 admin admin] PATH_INFO: `/v3/projects/6bea124ced3a41c1839129bb224679ab/users/f9f9838943f047dfaa45fb47a24b0844/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.887012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34295d-e332-48a0-83aa-4469bb372aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bea124ced3a41c1839129bb224679ab, user_id=f9f9838943f047dfaa45fb47a24b0844, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.889642 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34295d-e332-48a0-83aa-4469bb372aa1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.899418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:42.907535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1309/2604] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:42 2022] PUT /identity/v3/projects/6bea124ced3a41c1839129bb224679ab/users/f9f9838943f047dfaa45fb47a24b0844/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:42.908689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad7e5-7143-4fb8-852e-e3840242ffc2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.920681 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad7e5-7143-4fb8-852e-e3840242ffc2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.986304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c09c-a2e3-400f-a1d0-fe3749f5cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.987099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c09c-a2e3-400f-a1d0-fe3749f5cbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.987393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c09c-a2e3-400f-a1d0-fe3749f5cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.987677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c09c-a2e3-400f-a1d0-fe3749f5cbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.988418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c09c-a2e3-400f-a1d0-fe3749f5cbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.990036 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c09c-a2e3-400f-a1d0-fe3749f5cbd5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:43.002025 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1296/2605] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:43.005947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34295d-e332-48a0-83aa-4469bb372aa1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:43.016370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34295d-e332-48a0-83aa-4469bb372aa1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:43.021112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:43.022006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:43.022295 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:43.022579 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] PATH_INFO: `/v3/projects/6bea124ced3a41c1839129bb224679ab/users/f9f9838943f047dfaa45fb47a24b0844/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:43.024987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bea124ced3a41c1839129bb224679ab, user_id=f9f9838943f047dfaa45fb47a24b0844, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:43.027706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:43.052237 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1310/2606] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:43 2022] PUT /identity/v3/projects/6bea124ced3a41c1839129bb224679ab/users/f9f9838943f047dfaa45fb47a24b0844/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:43.054761 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91ae2-8659-41cc-a8bc-54e6b437673b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:43.055204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91ae2-8659-41cc-a8bc-54e6b437673b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:43.055740 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91ae2-8659-41cc-a8bc-54e6b437673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:43.084405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-30f91ae2-8659-41cc-a8bc-54e6b437673b None None] MFA Rules not processed for user `f9f9838943f047dfaa45fb47a24b0844`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:43.085637 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-30f91ae2-8659-41cc-a8bc-54e6b437673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:43.157858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1297/2607] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:43.170338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:43.172118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:43.235393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c625-3603-476b-8382-bdbee84d791b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:43.239032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:43.239688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:43.239974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:43.240254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:43.250794 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:43.252249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:43.262527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1311/2608] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:43.351855 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f91ae2-8659-41cc-a8bc-54e6b437673b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:43.353804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-30f91ae2-8659-41cc-a8bc-54e6b437673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:43.365560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f91ae2-8659-41cc-a8bc-54e6b437673b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:43.369736 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0590a0-19e8-4c23-ae98-f0f02a135fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:43.370543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0590a0-19e8-4c23-ae98-f0f02a135fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:43.370865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0590a0-19e8-4c23-ae98-f0f02a135fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:43.371146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0590a0-19e8-4c23-ae98-f0f02a135fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:43.379452 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:43.429990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0590a0-19e8-4c23-ae98-f0f02a135fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:43.431427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0590a0-19e8-4c23-ae98-f0f02a135fe4 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:43.440187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1298/2609] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:39:45.603005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:45.604420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:45.659120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05000a-a3ea-4106-ae01-16ea4887226d service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:45.662605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc18e5-2a0a-4893-bfa8-19f9ec00b997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:45.663275 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc18e5-2a0a-4893-bfa8-19f9ec00b997 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:45.663560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc18e5-2a0a-4893-bfa8-19f9ec00b997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:45.663838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc18e5-2a0a-4893-bfa8-19f9ec00b997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:45.665545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-00fc18e5-2a0a-4893-bfa8-19f9ec00b997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:45.725834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc18e5-2a0a-4893-bfa8-19f9ec00b997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:45.727299 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc18e5-2a0a-4893-bfa8-19f9ec00b997 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:45.736774 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1312/2610] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:48.172807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0590a0-19e8-4c23-ae98-f0f02a135fe4 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:48.184533 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0590a0-19e8-4c23-ae98-f0f02a135fe4 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:48.189183 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:48.190735 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:48.191386 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:48.191738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] PATH_INFO: `/v3/users/4e3189bb35e94d459e8b9a0207fe40e2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:48.193059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3189bb35e94d459e8b9a0207fe40e2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:48.195099 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:48.254821 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3189bb35e94d459e8b9a0207fe40e2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.256010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3189bb35e94d459e8b9a0207fe40e2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.265798 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3189bb35e94d459e8b9a0207fe40e2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.275405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3189bb35e94d459e8b9a0207fe40e2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.295343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3189bb35e94d459e8b9a0207fe40e2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.302192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1299/2611] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:48 2022] DELETE /identity/v3/users/4e3189bb35e94d459e8b9a0207fe40e2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:48.306599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012933e-5709-4d2a-ae02-0072601c701f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:48.307739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012933e-5709-4d2a-ae02-0072601c701f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:48.308029 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012933e-5709-4d2a-ae02-0072601c701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:48.327818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1012933e-5709-4d2a-ae02-0072601c701f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:48.329215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1012933e-5709-4d2a-ae02-0072601c701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:48.365002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:48.393219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1313/2612] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:48.405510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:48.409825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:48.501704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492574-7cd4-44c0-ba22-68a921f5548f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:48.505677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:48.506513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:48.506646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:48.506949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:48.517938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:48.519424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:48.530939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1300/2613] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:48.779066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012933e-5709-4d2a-ae02-0072601c701f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:48.780490 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1012933e-5709-4d2a-ae02-0072601c701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:48.792776 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012933e-5709-4d2a-ae02-0072601c701f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:48.797908 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:48.798781 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:48.799077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:48.799363 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] PATH_INFO: `/v3/users/4019001e534148e69c25c4d84b3a7f6e` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:48.800566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4019001e534148e69c25c4d84b3a7f6e)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:48.802719 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:48.860735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4019001e534148e69c25c4d84b3a7f6e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.873128 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4019001e534148e69c25c4d84b3a7f6e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.873873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4019001e534148e69c25c4d84b3a7f6e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.881499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4019001e534148e69c25c4d84b3a7f6e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.889581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4019001e534148e69c25c4d84b3a7f6e'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:48.895418 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1314/2614] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:48 2022] DELETE /identity/v3/users/4019001e534148e69c25c4d84b3a7f6e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:48.960847 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:48.962352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:48.976377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c4e5-8613-4568-b084-205f172142e2 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.001342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:49.046264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.047305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.047596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.048417 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] PATH_INFO: `/v3/projects/212cac5ca2f64cdb8d2d93c5a173b0fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.049282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=212cac5ca2f64cdb8d2d93c5a173b0fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.051326 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.101658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.103564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.104790 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212cac5ca2f64cdb8d2d93c5a173b0fa', 'request_id': 'req-ca18180f-9779-4d20-9fec-948da42c46ea'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.111638 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212cac5ca2f64cdb8d2d93c5a173b0fa', 'request_id': 'req-ca18180f-9779-4d20-9fec-948da42c46ea'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.118978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb0155-ba0a-4740-a2f4-7e6c7df76728 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.119151 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212cac5ca2f64cdb8d2d93c5a173b0fa', 'request_id': 'req-ca18180f-9779-4d20-9fec-948da42c46ea'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.144054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] The token cache is being invalidate because project 212cac5ca2f64cdb8d2d93c5a173b0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:49.144351 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.145717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.147883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1301/2615] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:48 2022] DELETE /identity/v3/projects/212cac5ca2f64cdb8d2d93c5a173b0fa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:49.151794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.153123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.181747 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.182648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.182970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.183255 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] PATH_INFO: `/v3/projects/15202d29e843404490b7cfffcde73640` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.184504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15202d29e843404490b7cfffcde73640)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.186425 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.218276 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18180f-9779-4d20-9fec-948da42c46ea admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.223131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.224088 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.224383 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.224666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] PATH_INFO: `/v3/users/f9f9838943f047dfaa45fb47a24b0844` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.225888 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f9838943f047dfaa45fb47a24b0844)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.227865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.235371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15202d29e843404490b7cfffcde73640', 'request_id': 'req-5743d7ab-0288-4a90-baf0-fe5a88481132'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.239223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:49.242568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15202d29e843404490b7cfffcde73640', 'request_id': 'req-5743d7ab-0288-4a90-baf0-fe5a88481132'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.249260 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15202d29e843404490b7cfffcde73640', 'request_id': 'req-5743d7ab-0288-4a90-baf0-fe5a88481132'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.268966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] The token cache is being invalidate because project 15202d29e843404490b7cfffcde73640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:49.269322 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.270034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-5743d7ab-0288-4a90-baf0-fe5a88481132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.271985 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1315/2616] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:49 2022] DELETE /identity/v3/projects/15202d29e843404490b7cfffcde73640 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:49.277065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404884-118f-44c2-b6cb-477bcf5de593 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.277887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404884-118f-44c2-b6cb-477bcf5de593 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.278159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404884-118f-44c2-b6cb-477bcf5de593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.284843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f9838943f047dfaa45fb47a24b0844'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.285553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f9838943f047dfaa45fb47a24b0844'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.301938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f9838943f047dfaa45fb47a24b0844'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.303056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-dc404884-118f-44c2-b6cb-477bcf5de593 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:49.304351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-dc404884-118f-44c2-b6cb-477bcf5de593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.304787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:49.312253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f9838943f047dfaa45fb47a24b0844'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.331237 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4c7f2041-56b0-4796-be55-17e3285a14ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f9838943f047dfaa45fb47a24b0844'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.339517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1302/2617] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:49 2022] DELETE /identity/v3/users/f9f9838943f047dfaa45fb47a24b0844 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:49.380977 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1316/2618] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:49.389465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74832a-1d8f-416d-889d-64c0e6d0c594 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.389765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74832a-1d8f-416d-889d-64c0e6d0c594 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.390296 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74832a-1d8f-416d-889d-64c0e6d0c594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.410293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7d74832a-1d8f-416d-889d-64c0e6d0c594 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:49.411576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7d74832a-1d8f-416d-889d-64c0e6d0c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.477969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1303/2619] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:49.481877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc404884-118f-44c2-b6cb-477bcf5de593 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.492073 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc404884-118f-44c2-b6cb-477bcf5de593 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.497542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.498210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.498497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.498791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.499523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:49.499834 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.501430 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.519639 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1317/2620] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:49.520891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74832a-1d8f-416d-889d-64c0e6d0c594 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.532878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74832a-1d8f-416d-889d-64c0e6d0c594 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.537602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.538274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.538560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.538884 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.539588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.541476 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.568216 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1304/2621] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:49.573368 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.583319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21b9fa-c4e7-4fe0-9136-5ac15b402a31 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.643152 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b197e-153b-4fd5-8f59-360abe3330cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.643845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b197e-153b-4fd5-8f59-360abe3330cb admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.644137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b197e-153b-4fd5-8f59-360abe3330cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.644424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b197e-153b-4fd5-8f59-360abe3330cb admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.645282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b197e-153b-4fd5-8f59-360abe3330cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.647209 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b197e-153b-4fd5-8f59-360abe3330cb admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.650722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.652591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.668648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97155f2-083f-451a-8089-a1585c73fda1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.670592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1318/2622] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:49.674519 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b197e-153b-4fd5-8f59-360abe3330cb admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.677905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.678807 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.679135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.679419 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] PATH_INFO: `/v3/projects/6bea124ced3a41c1839129bb224679ab` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.680772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bea124ced3a41c1839129bb224679ab)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.683370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.693578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b197e-153b-4fd5-8f59-360abe3330cb admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.698764 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112926ee-8be8-458f-a538-0b23c7b9fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.699448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112926ee-8be8-458f-a538-0b23c7b9fd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.699738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112926ee-8be8-458f-a538-0b23c7b9fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.700014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112926ee-8be8-458f-a538-0b23c7b9fd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.700733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112926ee-8be8-458f-a538-0b23c7b9fd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.702314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112926ee-8be8-458f-a538-0b23c7b9fd97 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.713012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1319/2623] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:49.717011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112926ee-8be8-458f-a538-0b23c7b9fd97 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.726568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112926ee-8be8-458f-a538-0b23c7b9fd97 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.733491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bea124ced3a41c1839129bb224679ab', 'request_id': 'req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.740054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bea124ced3a41c1839129bb224679ab', 'request_id': 'req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.746188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bea124ced3a41c1839129bb224679ab', 'request_id': 'req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.759247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] The token cache is being invalidate because project 6bea124ced3a41c1839129bb224679ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:49.759540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.760203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2b21e3dc-c837-46e4-85a1-bf8e9cd41e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:49.761756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1305/2624] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:49 2022] DELETE /identity/v3/projects/6bea124ced3a41c1839129bb224679ab => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:49.766313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e8f4-345d-44c6-aa13-160404719905 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.766610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e8f4-345d-44c6-aa13-160404719905 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.766928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e8f4-345d-44c6-aa13-160404719905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.773183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:49.784297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6cc5e8f4-345d-44c6-aa13-160404719905 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:49.785488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6cc5e8f4-345d-44c6-aa13-160404719905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.787072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.787753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.788057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.788341 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.789069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.790708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.794023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1306/2625] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:49.801832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1320/2626] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:49.801999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5014-bb98-4bcc-931e-7ba33810fd1c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.802302 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5014-bb98-4bcc-931e-7ba33810fd1c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.802623 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5014-bb98-4bcc-931e-7ba33810fd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.805723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.808093 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.821097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629988ff-3e4e-4fb9-b79d-783e28caed9b admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.822716 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-49ad5014-bb98-4bcc-931e-7ba33810fd1c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:49.824065 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-49ad5014-bb98-4bcc-931e-7ba33810fd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.825822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d95e0-4dbc-4ed0-bdcc-fa00ffaaea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.826716 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d95e0-4dbc-4ed0-bdcc-fa00ffaaea65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.827044 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d95e0-4dbc-4ed0-bdcc-fa00ffaaea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.827331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d95e0-4dbc-4ed0-bdcc-fa00ffaaea65 admin admin] PATH_INFO: `/v3/projects/93e7d9d7bab14e9b8fb20e4965e399ac/users/83d4109886df4404aeb078f63a5a0bfd/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.832049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1307/2627] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:49.836304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad5014-bb98-4bcc-931e-7ba33810fd1c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.844351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d95e0-4dbc-4ed0-bdcc-fa00ffaaea65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e7d9d7bab14e9b8fb20e4965e399ac, user_id=83d4109886df4404aeb078f63a5a0bfd, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.845720 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad5014-bb98-4bcc-931e-7ba33810fd1c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.847853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d95e0-4dbc-4ed0-bdcc-fa00ffaaea65 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.850368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.851067 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.851349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.851630 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.852356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:49.852678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.854893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.861727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1321/2628] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:49 2022] PUT /identity/v3/projects/93e7d9d7bab14e9b8fb20e4965e399ac/users/83d4109886df4404aeb078f63a5a0bfd/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:49.871158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1308/2629] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:39:49.872080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.872763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0473-1b41-4006-bd9a-88e21dde6025 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.873200 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0473-1b41-4006-bd9a-88e21dde6025 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.873484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0473-1b41-4006-bd9a-88e21dde6025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.881883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03ee10-9707-4f54-962b-62795c7a294b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.886491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:49.903167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1d5a0473-1b41-4006-bd9a-88e21dde6025 None None] MFA Rules not processed for user `83d4109886df4404aeb078f63a5a0bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:49.904387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1d5a0473-1b41-4006-bd9a-88e21dde6025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.942866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.943678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.944063 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.944440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.945246 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.947271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.970151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1322/2630] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:49.973038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1309/2631] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:39:49.979399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0473-1b41-4006-bd9a-88e21dde6025 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.982312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.983973 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.990268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0473-1b41-4006-bd9a-88e21dde6025 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:50.047230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b10f9c-6718-4807-b9f5-cacd82d5aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:50.047230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b10f9c-6718-4807-b9f5-cacd82d5aa15 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:50.047230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b10f9c-6718-4807-b9f5-cacd82d5aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:50.047230 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b10f9c-6718-4807-b9f5-cacd82d5aa15 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:50.048042 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b10f9c-6718-4807-b9f5-cacd82d5aa15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:50.049673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b10f9c-6718-4807-b9f5-cacd82d5aa15 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:50.067465 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c4406-9be8-4510-89f0-0022e2848314 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:50.073463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7db97-b288-49a8-a5bf-305e1a126394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:50.074129 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7db97-b288-49a8-a5bf-305e1a126394 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:50.074418 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7db97-b288-49a8-a5bf-305e1a126394 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:50.074861 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7db97-b288-49a8-a5bf-305e1a126394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:50.074979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1323/2632] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:50.078638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b10f9c-6718-4807-b9f5-cacd82d5aa15 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:50.088825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b10f9c-6718-4807-b9f5-cacd82d5aa15 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:50.093383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50809d-f220-4de9-ac0b-30add76c2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:50.094028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50809d-f220-4de9-ac0b-30add76c2ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:50.094311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50809d-f220-4de9-ac0b-30add76c2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:50.094615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50809d-f220-4de9-ac0b-30add76c2ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:50.095369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50809d-f220-4de9-ac0b-30add76c2ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:50.097009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50809d-f220-4de9-ac0b-30add76c2ba0 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:50.107569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1324/2633] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:50.111228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50809d-f220-4de9-ac0b-30add76c2ba0 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:50.121030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50809d-f220-4de9-ac0b-30add76c2ba0 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:50.125657 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af248-f8da-479d-a0fe-3c2b2a131209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:50.126300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af248-f8da-479d-a0fe-3c2b2a131209 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:50.126634 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af248-f8da-479d-a0fe-3c2b2a131209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:50.126938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af248-f8da-479d-a0fe-3c2b2a131209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:50.127649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07af248-f8da-479d-a0fe-3c2b2a131209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:50.129269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07af248-f8da-479d-a0fe-3c2b2a131209 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:50.134559 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7db97-b288-49a8-a5bf-305e1a126394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:50.137232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7db97-b288-49a8-a5bf-305e1a126394 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:50.139839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1325/2634] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:50.143729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af248-f8da-479d-a0fe-3c2b2a131209 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:50.146939 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1310/2635] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:39:50.153970 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af248-f8da-479d-a0fe-3c2b2a131209 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:50.159402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:50.160297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:50.160581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:50.161058 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] PATH_INFO: `/v3/projects/2aab11beedf34104a0c17fb252567c5d/users/f30604098cd045d6924f8d0238f4a5d8/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:50.177265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aab11beedf34104a0c17fb252567c5d, user_id=f30604098cd045d6924f8d0238f4a5d8, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:50.179904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:50.183600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:50.195483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1326/2636] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:50 2022] PUT /identity/v3/projects/2aab11beedf34104a0c17fb252567c5d/users/f30604098cd045d6924f8d0238f4a5d8/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:50.209042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308f18-bb22-42be-824a-77eb43b3b8ee None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:50.209368 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308f18-bb22-42be-824a-77eb43b3b8ee None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:50.209652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308f18-bb22-42be-824a-77eb43b3b8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:50.237335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f3308f18-bb22-42be-824a-77eb43b3b8ee None None] MFA Rules not processed for user `f30604098cd045d6924f8d0238f4a5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:50.238541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f3308f18-bb22-42be-824a-77eb43b3b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:50.257108 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:50.305198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1311/2637] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:50.318360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:50.320469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:50.380802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb632e-984b-44ef-a325-aa637f22e456 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:50.384750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027fec-0f1a-401e-90de-05e73bdc1bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:50.385982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027fec-0f1a-401e-90de-05e73bdc1bbb service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:50.386226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027fec-0f1a-401e-90de-05e73bdc1bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:50.386528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027fec-0f1a-401e-90de-05e73bdc1bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:50.395389 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027fec-0f1a-401e-90de-05e73bdc1bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:50.397035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027fec-0f1a-401e-90de-05e73bdc1bbb service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:50.414948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1327/2638] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:52.821015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3308f18-bb22-42be-824a-77eb43b3b8ee None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:52.883131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3308f18-bb22-42be-824a-77eb43b3b8ee None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:52.888091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:52.888955 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:52.889239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:52.889518 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] PATH_INFO: `/v3/users/83d4109886df4404aeb078f63a5a0bfd` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:52.890682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d4109886df4404aeb078f63a5a0bfd)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:52.892620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:52.938070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d4109886df4404aeb078f63a5a0bfd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:52.938659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d4109886df4404aeb078f63a5a0bfd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:52.945610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d4109886df4404aeb078f63a5a0bfd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:52.953361 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d4109886df4404aeb078f63a5a0bfd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:52.965628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d4109886df4404aeb078f63a5a0bfd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:52.971427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1312/2639] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:52 2022] DELETE /identity/v3/users/83d4109886df4404aeb078f63a5a0bfd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:52.976039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2a01-fbb9-4e5e-aa36-bbf1124779a8 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:52.976552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2a01-fbb9-4e5e-aa36-bbf1124779a8 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:52.976656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2a01-fbb9-4e5e-aa36-bbf1124779a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:52.993523 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-fb4e2a01-fbb9-4e5e-aa36-bbf1124779a8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:52.995051 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fb4e2a01-fbb9-4e5e-aa36-bbf1124779a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.053550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1328/2640] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:53.063705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.065137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.108017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:53.123667 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1a9b3-117d-449f-bf7d-3ba955b60e3e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.127215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.127866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.128177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.128451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.137896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.139349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.148645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1313/2641] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:53.408778 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2a01-fbb9-4e5e-aa36-bbf1124779a8 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.408944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.410196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fb4e2a01-fbb9-4e5e-aa36-bbf1124779a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.410310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.424531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c454-15a0-4d62-9742-dd94e112f6af service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.429164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.429326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2a01-fbb9-4e5e-aa36-bbf1124779a8 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.430116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.430475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.430883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] PATH_INFO: `/v3/projects/93e7d9d7bab14e9b8fb20e4965e399ac` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.432146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e7d9d7bab14e9b8fb20e4965e399ac)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.434722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.435053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.435830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.436110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.436388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] PATH_INFO: `/v3/users/f30604098cd045d6924f8d0238f4a5d8` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.437599 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30604098cd045d6924f8d0238f4a5d8)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.439643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.485810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e7d9d7bab14e9b8fb20e4965e399ac', 'request_id': 'req-951ef159-a2ff-4cab-b338-8e6c27662552'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.487105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30604098cd045d6924f8d0238f4a5d8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.492189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e7d9d7bab14e9b8fb20e4965e399ac', 'request_id': 'req-951ef159-a2ff-4cab-b338-8e6c27662552'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.498343 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e7d9d7bab14e9b8fb20e4965e399ac', 'request_id': 'req-951ef159-a2ff-4cab-b338-8e6c27662552'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.500595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30604098cd045d6924f8d0238f4a5d8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.501455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30604098cd045d6924f8d0238f4a5d8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.508688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30604098cd045d6924f8d0238f4a5d8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.511583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] The token cache is being invalidate because project 93e7d9d7bab14e9b8fb20e4965e399ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:53.512545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.513254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-951ef159-a2ff-4cab-b338-8e6c27662552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.514917 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1314/2642] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:53 2022] DELETE /identity/v3/projects/93e7d9d7bab14e9b8fb20e4965e399ac => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:53.516440 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-0abd03ed-b326-478d-8d8f-d0547de42ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30604098cd045d6924f8d0238f4a5d8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:53.519938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23707581-9cf9-4c90-8d6b-21703c188cc1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.520222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23707581-9cf9-4c90-8d6b-21703c188cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.520511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23707581-9cf9-4c90-8d6b-21703c188cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.523142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1329/2643] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:53 2022] DELETE /identity/v3/users/f30604098cd045d6924f8d0238f4a5d8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:53.527457 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4176-e985-4ab8-8f51-8457f395d803 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.528357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4176-e985-4ab8-8f51-8457f395d803 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.528649 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4176-e985-4ab8-8f51-8457f395d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.541057 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-23707581-9cf9-4c90-8d6b-21703c188cc1 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:53.542260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-23707581-9cf9-4c90-8d6b-21703c188cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.545561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ad4d4176-e985-4ab8-8f51-8457f395d803 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:53.546742 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ad4d4176-e985-4ab8-8f51-8457f395d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.550626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:53.602277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1315/2644] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:53.607062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1330/2645] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:53.611406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4abde-97ed-4673-8ed9-83879781f947 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.611731 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4abde-97ed-4673-8ed9-83879781f947 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.612019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4abde-97ed-4673-8ed9-83879781f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.616405 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4176-e985-4ab8-8f51-8457f395d803 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.617757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ad4d4176-e985-4ab8-8f51-8457f395d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.630580 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6bd4abde-97ed-4673-8ed9-83879781f947 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:53.631802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6bd4abde-97ed-4673-8ed9-83879781f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.640362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1316/2646] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:53.644978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4abde-97ed-4673-8ed9-83879781f947 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.654961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4abde-97ed-4673-8ed9-83879781f947 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.659591 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.660243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.660532 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.660814 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.661537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:53.661864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.663490 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.674539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4176-e985-4ab8-8f51-8457f395d803 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.675551 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1317/2647] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:53.678560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480281d4-1289-4900-9b87-909fdcc8a861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.679246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480281d4-1289-4900-9b87-909fdcc8a861 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.679532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480281d4-1289-4900-9b87-909fdcc8a861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.679813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480281d4-1289-4900-9b87-909fdcc8a861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.679942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.689075 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480281d4-1289-4900-9b87-909fdcc8a861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.689877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bceeb2-04cd-4a65-98c1-18708c1ee400 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.690512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480281d4-1289-4900-9b87-909fdcc8a861 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.694456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28dc16-1678-4d55-95a3-9206e1540465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.695121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28dc16-1678-4d55-95a3-9206e1540465 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.695416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28dc16-1678-4d55-95a3-9206e1540465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.695699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28dc16-1678-4d55-95a3-9206e1540465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.696373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28dc16-1678-4d55-95a3-9206e1540465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.698244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28dc16-1678-4d55-95a3-9206e1540465 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.700640 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1331/2648] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:39:53.728803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1318/2649] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:53 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:39:53.730204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480281d4-1289-4900-9b87-909fdcc8a861 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.739895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480281d4-1289-4900-9b87-909fdcc8a861 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.798608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bef65-6f00-44e3-baec-4fb6147b7a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.799313 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bef65-6f00-44e3-baec-4fb6147b7a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.799596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bef65-6f00-44e3-baec-4fb6147b7a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.799876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bef65-6f00-44e3-baec-4fb6147b7a4f admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.800596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bef65-6f00-44e3-baec-4fb6147b7a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.802499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bef65-6f00-44e3-baec-4fb6147b7a4f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.823055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1332/2650] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:53 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:53.827771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28dc16-1678-4d55-95a3-9206e1540465 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.838503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28dc16-1678-4d55-95a3-9206e1540465 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.843468 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c6a5b-f9f8-4e63-99c0-fb5702a5923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.844140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6a5b-f9f8-4e63-99c0-fb5702a5923d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.844431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6a5b-f9f8-4e63-99c0-fb5702a5923d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.844715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c6a5b-f9f8-4e63-99c0-fb5702a5923d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.848224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c6a5b-f9f8-4e63-99c0-fb5702a5923d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.848224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c6a5b-f9f8-4e63-99c0-fb5702a5923d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.859093 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1319/2651] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:53.864972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bef65-6f00-44e3-baec-4fb6147b7a4f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.875305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bef65-6f00-44e3-baec-4fb6147b7a4f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.879877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c890a1c-572a-4d78-a879-b12d112c63ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.880542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c890a1c-572a-4d78-a879-b12d112c63ee admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.880825 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c890a1c-572a-4d78-a879-b12d112c63ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.881098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c890a1c-572a-4d78-a879-b12d112c63ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.881823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c890a1c-572a-4d78-a879-b12d112c63ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.883459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c890a1c-572a-4d78-a879-b12d112c63ee admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.894378 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1333/2652] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:53.898672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c6a5b-f9f8-4e63-99c0-fb5702a5923d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.908900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c6a5b-f9f8-4e63-99c0-fb5702a5923d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.913610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.914497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.914800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.915095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] PATH_INFO: `/v3/projects/904f293110bb4889a5b66405cc3edb8b/users/0f26c41ba2984c30ae297d2650ffa211/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.927783 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:53.932579 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=904f293110bb4889a5b66405cc3edb8b, user_id=0f26c41ba2984c30ae297d2650ffa211, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.935852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.951843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1320/2653] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:53 2022] PUT /identity/v3/projects/904f293110bb4889a5b66405cc3edb8b/users/0f26c41ba2984c30ae297d2650ffa211/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:53.962394 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803b742-9b23-4fc8-8789-0af8930f77ef None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.962597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803b742-9b23-4fc8-8789-0af8930f77ef None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.962933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803b742-9b23-4fc8-8789-0af8930f77ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.991071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.992776 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.993867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a803b742-9b23-4fc8-8789-0af8930f77ef None None] MFA Rules not processed for user `0f26c41ba2984c30ae297d2650ffa211`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:53.995221 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a803b742-9b23-4fc8-8789-0af8930f77ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:54.021587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:54.069831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6e699-ed1f-474c-84bc-37ea4e4deb53 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:54.075003 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1334/2654] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:54.075163 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:54.075979 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:54.076266 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:54.076543 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] PATH_INFO: `/v3/projects/2aab11beedf34104a0c17fb252567c5d` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:54.077738 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aab11beedf34104a0c17fb252567c5d)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:54.079795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:54.086201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803b742-9b23-4fc8-8789-0af8930f77ef None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:54.087609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a803b742-9b23-4fc8-8789-0af8930f77ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:54.127836 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aab11beedf34104a0c17fb252567c5d', 'request_id': 'req-cecefa90-11e7-42d2-92ec-6f3b9d404626'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.133930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aab11beedf34104a0c17fb252567c5d', 'request_id': 'req-cecefa90-11e7-42d2-92ec-6f3b9d404626'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.140365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aab11beedf34104a0c17fb252567c5d', 'request_id': 'req-cecefa90-11e7-42d2-92ec-6f3b9d404626'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.152365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] The token cache is being invalidate because project 2aab11beedf34104a0c17fb252567c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:54.152663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.153300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.154901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1321/2655] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:53 2022] DELETE /identity/v3/projects/2aab11beedf34104a0c17fb252567c5d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:54.170415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803b742-9b23-4fc8-8789-0af8930f77ef None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:54.240520 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd840d5-fd6c-4979-a188-f154ea2c8ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:54.241267 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd840d5-fd6c-4979-a188-f154ea2c8ee2 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:54.241493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd840d5-fd6c-4979-a188-f154ea2c8ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:54.241771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd840d5-fd6c-4979-a188-f154ea2c8ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:54.243669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ccd840d5-fd6c-4979-a188-f154ea2c8ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:54.303620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:54.306667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd840d5-fd6c-4979-a188-f154ea2c8ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:54.309119 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd840d5-fd6c-4979-a188-f154ea2c8ee2 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:54.319607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1335/2656] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:54.540010 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:54.541527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:54.604800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecefa90-11e7-42d2-92ec-6f3b9d404626 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:54.609320 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:54.610196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:54.610485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:54.610878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] PATH_INFO: `/v3/users/0f26c41ba2984c30ae297d2650ffa211` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:54.612068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f26c41ba2984c30ae297d2650ffa211)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:54.613984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:54.635420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:54.660436 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f26c41ba2984c30ae297d2650ffa211'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.661064 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f26c41ba2984c30ae297d2650ffa211'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.667985 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f26c41ba2984c30ae297d2650ffa211'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.675263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f26c41ba2984c30ae297d2650ffa211'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.687304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f26c41ba2984c30ae297d2650ffa211'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:54.693041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1322/2657] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:39:54 2022] DELETE /identity/v3/users/0f26c41ba2984c30ae297d2650ffa211 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:54.697574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3a43b-94c7-4f2f-944a-c8fd071d8064 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:54.697868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3a43b-94c7-4f2f-944a-c8fd071d8064 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:54.698148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3a43b-94c7-4f2f-944a-c8fd071d8064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:54.715758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-ffe3a43b-94c7-4f2f-944a-c8fd071d8064 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:54.716937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ffe3a43b-94c7-4f2f-944a-c8fd071d8064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:54.773852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1336/2658] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:39:54.783342 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:54.784727 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:54.840254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48543d9e-ab8d-4386-a69a-d4d47f857115 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:54.844159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbf5d1-1d80-4d55-b660-171e207d8563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:54.844842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbf5d1-1d80-4d55-b660-171e207d8563 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:54.845160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbf5d1-1d80-4d55-b660-171e207d8563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:54.845468 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbf5d1-1d80-4d55-b660-171e207d8563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:54.854566 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbf5d1-1d80-4d55-b660-171e207d8563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:54.856033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbf5d1-1d80-4d55-b660-171e207d8563 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:54.865427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1323/2659] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:55.127265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3a43b-94c7-4f2f-944a-c8fd071d8064 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.128861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ffe3a43b-94c7-4f2f-944a-c8fd071d8064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:55.143429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3a43b-94c7-4f2f-944a-c8fd071d8064 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.148474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.150545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.151113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.151347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] PATH_INFO: `/v3/projects/904f293110bb4889a5b66405cc3edb8b` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.152518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=904f293110bb4889a5b66405cc3edb8b)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.154392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.201332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '904f293110bb4889a5b66405cc3edb8b', 'request_id': 'req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:55.206675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '904f293110bb4889a5b66405cc3edb8b', 'request_id': 'req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:55.212680 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '904f293110bb4889a5b66405cc3edb8b', 'request_id': 'req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:55.224937 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] The token cache is being invalidate because project 904f293110bb4889a5b66405cc3edb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:39:55.225226 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:55.225836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8cbcdc2e-aeaf-42ce-bdc9-0f5aa952d4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:39:55.227658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1337/2660] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:39:55 2022] DELETE /identity/v3/projects/904f293110bb4889a5b66405cc3edb8b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:55.232964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154bc3-6cf9-4898-8c02-6c1f33413dd3 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.233260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154bc3-6cf9-4898-8c02-6c1f33413dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.233542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154bc3-6cf9-4898-8c02-6c1f33413dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.252017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3b154bc3-6cf9-4898-8c02-6c1f33413dd3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:55.253222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3b154bc3-6cf9-4898-8c02-6c1f33413dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:55.311573 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1324/2661] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:55.319111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4fa7-14d8-497e-bcf7-7379f5681733 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.319415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4fa7-14d8-497e-bcf7-7379f5681733 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.319704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4fa7-14d8-497e-bcf7-7379f5681733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.337836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-75ef4fa7-14d8-497e-bcf7-7379f5681733 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:55.339111 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-75ef4fa7-14d8-497e-bcf7-7379f5681733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:55.347568 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1338/2662] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:55.351664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b154bc3-6cf9-4898-8c02-6c1f33413dd3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.361661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b154bc3-6cf9-4898-8c02-6c1f33413dd3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.366538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.367222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.367512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.368083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.368818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:39:55.369116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.370696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.381999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1325/2663] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:55.386024 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef4fa7-14d8-497e-bcf7-7379f5681733 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.395182 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef4fa7-14d8-497e-bcf7-7379f5681733 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.399855 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782898d-55a5-438d-b3be-8cfd3f992b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.400504 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782898d-55a5-438d-b3be-8cfd3f992b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.400791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782898d-55a5-438d-b3be-8cfd3f992b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.401074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782898d-55a5-438d-b3be-8cfd3f992b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.401771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782898d-55a5-438d-b3be-8cfd3f992b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.404236 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782898d-55a5-438d-b3be-8cfd3f992b6e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.429671 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1339/2664] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:55 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:55.433702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.443475 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a610ea7-7849-48ff-ae08-dc85197eaebc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.469268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:55.502290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad43d14-242d-4f96-a261-9cfe3000064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.502978 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad43d14-242d-4f96-a261-9cfe3000064f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.503268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad43d14-242d-4f96-a261-9cfe3000064f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.503545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad43d14-242d-4f96-a261-9cfe3000064f admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.504234 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad43d14-242d-4f96-a261-9cfe3000064f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.506125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad43d14-242d-4f96-a261-9cfe3000064f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.524896 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1326/2665] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:55 2022] POST /identity/v3/users => generated 278 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:39:55.529485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782898d-55a5-438d-b3be-8cfd3f992b6e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.539915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782898d-55a5-438d-b3be-8cfd3f992b6e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.545596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77123a-54e5-4af1-84bd-181a7a53cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.546308 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77123a-54e5-4af1-84bd-181a7a53cf73 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.546596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77123a-54e5-4af1-84bd-181a7a53cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.546922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77123a-54e5-4af1-84bd-181a7a53cf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.547687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77123a-54e5-4af1-84bd-181a7a53cf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.549290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77123a-54e5-4af1-84bd-181a7a53cf73 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.559549 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1340/2666] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:55.563305 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad43d14-242d-4f96-a261-9cfe3000064f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.572949 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad43d14-242d-4f96-a261-9cfe3000064f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.577493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef0d4-2ae4-4981-a36c-ef03f4d6d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.578145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef0d4-2ae4-4981-a36c-ef03f4d6d399 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.578432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef0d4-2ae4-4981-a36c-ef03f4d6d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.578713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef0d4-2ae4-4981-a36c-ef03f4d6d399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.579493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ef0d4-2ae4-4981-a36c-ef03f4d6d399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.581059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ef0d4-2ae4-4981-a36c-ef03f4d6d399 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.591232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1327/2667] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:39:55.595204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77123a-54e5-4af1-84bd-181a7a53cf73 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.604780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77123a-54e5-4af1-84bd-181a7a53cf73 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.609927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b1e0-04bf-4680-b5c2-aa8dff3d0bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.610813 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b1e0-04bf-4680-b5c2-aa8dff3d0bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.611109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b1e0-04bf-4680-b5c2-aa8dff3d0bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.611391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b1e0-04bf-4680-b5c2-aa8dff3d0bb5 admin admin] PATH_INFO: `/v3/projects/2697c2f7fa734ff88c1c652b1b288078/users/9c2e53dd40444561b6fa61d9e1190b82/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.625686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587b1e0-04bf-4680-b5c2-aa8dff3d0bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2697c2f7fa734ff88c1c652b1b288078, user_id=9c2e53dd40444561b6fa61d9e1190b82, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.628337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587b1e0-04bf-4680-b5c2-aa8dff3d0bb5 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.641940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1341/2668] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:55 2022] PUT /identity/v3/projects/2697c2f7fa734ff88c1c652b1b288078/users/9c2e53dd40444561b6fa61d9e1190b82/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:55.653831 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3503-8539-4f87-a97a-437c8d916554 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.654152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3503-8539-4f87-a97a-437c8d916554 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.654432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3503-8539-4f87-a97a-437c8d916554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.680869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-947d3503-8539-4f87-a97a-437c8d916554 None None] MFA Rules not processed for user `9c2e53dd40444561b6fa61d9e1190b82`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:55.682068 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-947d3503-8539-4f87-a97a-437c8d916554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:55.745565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1328/2669] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:55.750062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b1e0-04bf-4680-b5c2-aa8dff3d0bb5 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.767467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:55.816175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b1e0-04bf-4680-b5c2-aa8dff3d0bb5 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.821126 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba658e2-d009-4ef3-bb9c-befa4e406646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.821805 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba658e2-d009-4ef3-bb9c-befa4e406646 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.822115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba658e2-d009-4ef3-bb9c-befa4e406646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.822396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba658e2-d009-4ef3-bb9c-befa4e406646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.823139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba658e2-d009-4ef3-bb9c-befa4e406646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.825633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba658e2-d009-4ef3-bb9c-befa4e406646 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.850241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1342/2670] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:39:55 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:55.854567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d3503-8539-4f87-a97a-437c8d916554 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.865225 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d3503-8539-4f87-a97a-437c8d916554 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.922445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe0d1-0872-4945-b1f6-e210c5fb3378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.923159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe0d1-0872-4945-b1f6-e210c5fb3378 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.923462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe0d1-0872-4945-b1f6-e210c5fb3378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.923748 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe0d1-0872-4945-b1f6-e210c5fb3378 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.924441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abe0d1-0872-4945-b1f6-e210c5fb3378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.926366 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abe0d1-0872-4945-b1f6-e210c5fb3378 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.952252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1329/2671] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:39:55 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:39:55.953832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba658e2-d009-4ef3-bb9c-befa4e406646 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:55.965811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba658e2-d009-4ef3-bb9c-befa4e406646 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:55.971578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546c432-a4ba-40ac-9473-fe127e5ce9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:55.972286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546c432-a4ba-40ac-9473-fe127e5ce9be admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.972571 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546c432-a4ba-40ac-9473-fe127e5ce9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.972853 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546c432-a4ba-40ac-9473-fe127e5ce9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.973691 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546c432-a4ba-40ac-9473-fe127e5ce9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:55.975328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546c432-a4ba-40ac-9473-fe127e5ce9be admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:55.986643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1343/2672] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:55.990873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe0d1-0872-4945-b1f6-e210c5fb3378 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:56.001300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe0d1-0872-4945-b1f6-e210c5fb3378 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:56.006086 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d228834-7669-4024-96ee-a68c02b9e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:56.007000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d228834-7669-4024-96ee-a68c02b9e02a admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:56.007289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d228834-7669-4024-96ee-a68c02b9e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:56.007598 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d228834-7669-4024-96ee-a68c02b9e02a admin admin] PATH_INFO: `/v3/projects/96008bc2fd7a4afa86bfc152f89e3efb/users/d81e6aa96800482dbc70f65e517fbbd8/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:56.024160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d228834-7669-4024-96ee-a68c02b9e02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96008bc2fd7a4afa86bfc152f89e3efb, user_id=d81e6aa96800482dbc70f65e517fbbd8, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:56.026895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d228834-7669-4024-96ee-a68c02b9e02a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:56.041190 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1330/2673] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:55 2022] PUT /identity/v3/projects/96008bc2fd7a4afa86bfc152f89e3efb/users/d81e6aa96800482dbc70f65e517fbbd8/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:39:56.045544 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546c432-a4ba-40ac-9473-fe127e5ce9be admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:56.055796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546c432-a4ba-40ac-9473-fe127e5ce9be admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:56.115731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae88a5-88fe-4d87-8d4a-48d1249b7637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:56.116584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88a5-88fe-4d87-8d4a-48d1249b7637 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:56.116875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88a5-88fe-4d87-8d4a-48d1249b7637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:56.117155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae88a5-88fe-4d87-8d4a-48d1249b7637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:56.117880 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae88a5-88fe-4d87-8d4a-48d1249b7637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:56.119539 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae88a5-88fe-4d87-8d4a-48d1249b7637 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:56.131225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1344/2674] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:39:56.135478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d228834-7669-4024-96ee-a68c02b9e02a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:56.141678 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:56.148311 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d228834-7669-4024-96ee-a68c02b9e02a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:56.153596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:56.154556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:56.154975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:56.155328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] PATH_INFO: `/v3/projects/96008bc2fd7a4afa86bfc152f89e3efb/users/d81e6aa96800482dbc70f65e517fbbd8/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:56.157406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=96008bc2fd7a4afa86bfc152f89e3efb, user_id=d81e6aa96800482dbc70f65e517fbbd8, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:56.160174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:56.171448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1331/2675] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:39:56 2022] PUT /identity/v3/projects/96008bc2fd7a4afa86bfc152f89e3efb/users/d81e6aa96800482dbc70f65e517fbbd8/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:39:56.181279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b29f0-de96-47e5-9992-e84abdda63c5 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:56.181575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b29f0-de96-47e5-9992-e84abdda63c5 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:56.181852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b29f0-de96-47e5-9992-e84abdda63c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:56.208328 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b73b29f0-de96-47e5-9992-e84abdda63c5 None None] MFA Rules not processed for user `d81e6aa96800482dbc70f65e517fbbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:56.209543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b73b29f0-de96-47e5-9992-e84abdda63c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:56.274944 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1345/2676] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:56.286020 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:56.287757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:56.345055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89092292-427a-4d87-bd89-1c24b3b993bd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:56.348670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb3012-e2d3-462e-9060-69eb4ca37387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:56.349314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3012-e2d3-462e-9060-69eb4ca37387 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:56.349603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3012-e2d3-462e-9060-69eb4ca37387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:56.349887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb3012-e2d3-462e-9060-69eb4ca37387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:56.358643 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb3012-e2d3-462e-9060-69eb4ca37387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:56.360107 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb3012-e2d3-462e-9060-69eb4ca37387 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:56.369448 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1332/2677] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:56.439330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b29f0-de96-47e5-9992-e84abdda63c5 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:56.449005 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b29f0-de96-47e5-9992-e84abdda63c5 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:56.452661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b29edd-64ba-4a5d-8516-e53931fbdf13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:56.453306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29edd-64ba-4a5d-8516-e53931fbdf13 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:56.453596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29edd-64ba-4a5d-8516-e53931fbdf13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:56.453873 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b29edd-64ba-4a5d-8516-e53931fbdf13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:56.462124 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:56.526912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b29edd-64ba-4a5d-8516-e53931fbdf13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:56.528349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b29edd-64ba-4a5d-8516-e53931fbdf13 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:56.537320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1346/2678] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:06.365259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:06.533154 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=23 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:11.084721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb3012-e2d3-462e-9060-69eb4ca37387 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:11.146491 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb3012-e2d3-462e-9060-69eb4ca37387 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:11.151007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:11.151882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:11.152169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:11.152447 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] PATH_INFO: `/v3/users/9c2e53dd40444561b6fa61d9e1190b82` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:11.153621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2e53dd40444561b6fa61d9e1190b82)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:11.155608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:11.201209 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2e53dd40444561b6fa61d9e1190b82'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.201722 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2e53dd40444561b6fa61d9e1190b82'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.209624 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2e53dd40444561b6fa61d9e1190b82'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.216800 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2e53dd40444561b6fa61d9e1190b82'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.228433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2e53dd40444561b6fa61d9e1190b82'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.234369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1333/2679] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:11 2022] DELETE /identity/v3/users/9c2e53dd40444561b6fa61d9e1190b82 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:11.239002 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb4f4c-30e5-43af-a0b2-7239b1243c48 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:11.239500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb4f4c-30e5-43af-a0b2-7239b1243c48 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:11.239617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb4f4c-30e5-43af-a0b2-7239b1243c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:11.257916 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-1bfb4f4c-30e5-43af-a0b2-7239b1243c48 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:11.259149 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1bfb4f4c-30e5-43af-a0b2-7239b1243c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:11.316206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1347/2680] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:11.325567 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:11.326984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:11.384290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e8aa-8e7c-4e10-bcb3-554f3517b204 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:11.387922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b6e92-d24b-4fb5-a868-0aa235b240e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:11.388564 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6e92-d24b-4fb5-a868-0aa235b240e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:11.388852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6e92-d24b-4fb5-a868-0aa235b240e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:11.389137 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6e92-d24b-4fb5-a868-0aa235b240e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:11.397980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b6e92-d24b-4fb5-a868-0aa235b240e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:11.399423 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b6e92-d24b-4fb5-a868-0aa235b240e2 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:11.408692 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1334/2681] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:11.671358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb4f4c-30e5-43af-a0b2-7239b1243c48 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:11.673489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1bfb4f4c-30e5-43af-a0b2-7239b1243c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:11.686040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb4f4c-30e5-43af-a0b2-7239b1243c48 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:11.691648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:11.692518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:11.692822 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:11.693096 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] PATH_INFO: `/v3/projects/2697c2f7fa734ff88c1c652b1b288078` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:11.694274 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2697c2f7fa734ff88c1c652b1b288078)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:11.696222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:11.744505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2697c2f7fa734ff88c1c652b1b288078', 'request_id': 'req-7893840d-32f5-42ab-8d15-605706c434df'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.749901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2697c2f7fa734ff88c1c652b1b288078', 'request_id': 'req-7893840d-32f5-42ab-8d15-605706c434df'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.757443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2697c2f7fa734ff88c1c652b1b288078', 'request_id': 'req-7893840d-32f5-42ab-8d15-605706c434df'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.769362 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] The token cache is being invalidate because project 2697c2f7fa734ff88c1c652b1b288078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:11.769699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.770336 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.771884 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1348/2682] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:11 2022] DELETE /identity/v3/projects/2697c2f7fa734ff88c1c652b1b288078 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:11.776013 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b6e92-d24b-4fb5-a868-0aa235b240e2 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:11.786362 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b6e92-d24b-4fb5-a868-0aa235b240e2 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:11.805011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:11.844519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:11.845335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:11.845628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:11.845910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] PATH_INFO: `/v3/users/d81e6aa96800482dbc70f65e517fbbd8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:11.847150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81e6aa96800482dbc70f65e517fbbd8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:11.849116 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:11.893709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81e6aa96800482dbc70f65e517fbbd8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.894348 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81e6aa96800482dbc70f65e517fbbd8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.901373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81e6aa96800482dbc70f65e517fbbd8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.908942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81e6aa96800482dbc70f65e517fbbd8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.920924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dbf88cc-9bb8-431b-88d7-698e9c39e2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81e6aa96800482dbc70f65e517fbbd8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:11.927357 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1335/2683] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:11 2022] DELETE /identity/v3/users/d81e6aa96800482dbc70f65e517fbbd8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:12.194244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.195701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:12.209292 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893840d-32f5-42ab-8d15-605706c434df admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:12.266901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:12.267772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.268057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.268333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] PATH_INFO: `/v3/projects/96008bc2fd7a4afa86bfc152f89e3efb` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.269512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=96008bc2fd7a4afa86bfc152f89e3efb)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:12.271475 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:12.301588 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:12.319254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96008bc2fd7a4afa86bfc152f89e3efb', 'request_id': 'req-bccfd98a-4786-4df1-836a-86b42b2517ab'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:12.324565 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96008bc2fd7a4afa86bfc152f89e3efb', 'request_id': 'req-bccfd98a-4786-4df1-836a-86b42b2517ab'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:12.330674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96008bc2fd7a4afa86bfc152f89e3efb', 'request_id': 'req-bccfd98a-4786-4df1-836a-86b42b2517ab'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:12.343722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] The token cache is being invalidate because project 96008bc2fd7a4afa86bfc152f89e3efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:12.344009 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:12.344625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bccfd98a-4786-4df1-836a-86b42b2517ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:12.346507 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1349/2684] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:12 2022] DELETE /identity/v3/projects/96008bc2fd7a4afa86bfc152f89e3efb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:12.351117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beab1d-3e3d-443e-980f-6b3f1431f2da None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.351584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beab1d-3e3d-443e-980f-6b3f1431f2da None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.351679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beab1d-3e3d-443e-980f-6b3f1431f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.369876 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-41beab1d-3e3d-443e-980f-6b3f1431f2da None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:12.371243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-41beab1d-3e3d-443e-980f-6b3f1431f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:12.429018 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1336/2685] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:12.438303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ce4dd-d351-4a2d-83fc-f421dc4864d7 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.438605 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ce4dd-d351-4a2d-83fc-f421dc4864d7 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.438932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ce4dd-d351-4a2d-83fc-f421dc4864d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.456729 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-a40ce4dd-d351-4a2d-83fc-f421dc4864d7 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:12.457930 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-a40ce4dd-d351-4a2d-83fc-f421dc4864d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:12.465733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1350/2686] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:12.470295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beab1d-3e3d-443e-980f-6b3f1431f2da None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.480011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beab1d-3e3d-443e-980f-6b3f1431f2da None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:12.485123 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:12.485772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.486058 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.486338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.487087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:40:12.487402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:12.488980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:12.500675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1337/2687] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:40:12.505965 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ce4dd-d351-4a2d-83fc-f421dc4864d7 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.515485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ce4dd-d351-4a2d-83fc-f421dc4864d7 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:12.520926 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2e84-53ae-4332-a01b-b87cbc0bf4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:12.521581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2e84-53ae-4332-a01b-b87cbc0bf4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.521870 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2e84-53ae-4332-a01b-b87cbc0bf4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.522151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2e84-53ae-4332-a01b-b87cbc0bf4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.522879 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e2e84-53ae-4332-a01b-b87cbc0bf4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:12.524780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e2e84-53ae-4332-a01b-b87cbc0bf4c8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:12.552685 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1351/2688] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:40:12 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:12.553813 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.564203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec406ef-598f-426f-8fae-18b40b611cab admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:12.590656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:12.623001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a74fe-25a9-4103-976d-a6d90305105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:12.623617 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a74fe-25a9-4103-976d-a6d90305105d admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.623933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a74fe-25a9-4103-976d-a6d90305105d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.624219 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a74fe-25a9-4103-976d-a6d90305105d admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.625398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a74fe-25a9-4103-976d-a6d90305105d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:12.627318 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a74fe-25a9-4103-976d-a6d90305105d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:12.647268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1338/2689] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:40:12 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:12.651344 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2e84-53ae-4332-a01b-b87cbc0bf4c8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.662097 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2e84-53ae-4332-a01b-b87cbc0bf4c8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:12.666687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da911b2-2857-4813-88b8-3056a0c6eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:12.667424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da911b2-2857-4813-88b8-3056a0c6eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.667712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da911b2-2857-4813-88b8-3056a0c6eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.667988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da911b2-2857-4813-88b8-3056a0c6eaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.668709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da911b2-2857-4813-88b8-3056a0c6eaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:12.670569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da911b2-2857-4813-88b8-3056a0c6eaf3 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:12.681697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1352/2690] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:12.685349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a74fe-25a9-4103-976d-a6d90305105d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.695629 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a74fe-25a9-4103-976d-a6d90305105d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:12.700164 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462b252-d109-49a3-96bc-840610b8c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:12.700820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b252-d109-49a3-96bc-840610b8c78c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.701113 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b252-d109-49a3-96bc-840610b8c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.701397 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b252-d109-49a3-96bc-840610b8c78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.702154 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462b252-d109-49a3-96bc-840610b8c78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:12.704329 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462b252-d109-49a3-96bc-840610b8c78c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:12.714239 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1339/2691] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:12.718294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da911b2-2857-4813-88b8-3056a0c6eaf3 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.728011 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da911b2-2857-4813-88b8-3056a0c6eaf3 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:12.732633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd386-bb8e-431a-8ce1-e3d8323eec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:12.733489 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd386-bb8e-431a-8ce1-e3d8323eec9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.733778 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd386-bb8e-431a-8ce1-e3d8323eec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.734057 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd386-bb8e-431a-8ce1-e3d8323eec9f admin admin] PATH_INFO: `/v3/projects/5165e3fa744c4804a84015fcf5ad28a6/users/36d46faf7c734bf7ba7783a02810f981/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.748165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd386-bb8e-431a-8ce1-e3d8323eec9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5165e3fa744c4804a84015fcf5ad28a6, user_id=36d46faf7c734bf7ba7783a02810f981, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:12.751578 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd386-bb8e-431a-8ce1-e3d8323eec9f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:12.764621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1353/2692] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:40:12 2022] PUT /identity/v3/projects/5165e3fa744c4804a84015fcf5ad28a6/users/36d46faf7c734bf7ba7783a02810f981/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:12.775570 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3d0e-8930-40ed-b6d4-7ed2e1e28c30 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.775897 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3d0e-8930-40ed-b6d4-7ed2e1e28c30 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.776184 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3d0e-8930-40ed-b6d4-7ed2e1e28c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.801878 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-458a3d0e-8930-40ed-b6d4-7ed2e1e28c30 None None] MFA Rules not processed for user `36d46faf7c734bf7ba7783a02810f981`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:12.803135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-458a3d0e-8930-40ed-b6d4-7ed2e1e28c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:12.866682 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1340/2693] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:12.871283 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd386-bb8e-431a-8ce1-e3d8323eec9f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.932113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd386-bb8e-431a-8ce1-e3d8323eec9f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:12.936643 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a8965-f844-4b5f-a652-707ab370827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:12.937326 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8965-f844-4b5f-a652-707ab370827d admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:12.937615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8965-f844-4b5f-a652-707ab370827d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:12.937897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8965-f844-4b5f-a652-707ab370827d admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:12.938577 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a8965-f844-4b5f-a652-707ab370827d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:12.940505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a8965-f844-4b5f-a652-707ab370827d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:12.966535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1354/2694] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:40:12 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:12.971227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3d0e-8930-40ed-b6d4-7ed2e1e28c30 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:12.981943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3d0e-8930-40ed-b6d4-7ed2e1e28c30 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:13.038079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66332-fee0-4507-915b-91345f3145c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:13.039050 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66332-fee0-4507-915b-91345f3145c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:13.039346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66332-fee0-4507-915b-91345f3145c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:13.039634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66332-fee0-4507-915b-91345f3145c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:13.040324 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66332-fee0-4507-915b-91345f3145c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:13.042238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66332-fee0-4507-915b-91345f3145c3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:13.065568 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1341/2695] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:40:12 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:13.070896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a8965-f844-4b5f-a652-707ab370827d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:13.081846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a8965-f844-4b5f-a652-707ab370827d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:13.086573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83057a-2dfd-42fd-a17b-15496c6e421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:13.087263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83057a-2dfd-42fd-a17b-15496c6e421a admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:13.087550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83057a-2dfd-42fd-a17b-15496c6e421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:13.087827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83057a-2dfd-42fd-a17b-15496c6e421a admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:13.088556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83057a-2dfd-42fd-a17b-15496c6e421a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:13.090159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83057a-2dfd-42fd-a17b-15496c6e421a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:13.101247 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1355/2696] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:13.105177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66332-fee0-4507-915b-91345f3145c3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:13.115200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66332-fee0-4507-915b-91345f3145c3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:13.119894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a875b-7b1d-4918-a57c-d1891fb5c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:13.120771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a875b-7b1d-4918-a57c-d1891fb5c2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:13.121059 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a875b-7b1d-4918-a57c-d1891fb5c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:13.121340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a875b-7b1d-4918-a57c-d1891fb5c2d2 admin admin] PATH_INFO: `/v3/projects/e5470a3d58da4d1bbf89efafd2133460/users/b162ed78907544b7bc0d83239c312076/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:13.135908 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a875b-7b1d-4918-a57c-d1891fb5c2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5470a3d58da4d1bbf89efafd2133460, user_id=b162ed78907544b7bc0d83239c312076, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:13.138586 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a875b-7b1d-4918-a57c-d1891fb5c2d2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:13.151822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1342/2697] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:40:13 2022] PUT /identity/v3/projects/e5470a3d58da4d1bbf89efafd2133460/users/b162ed78907544b7bc0d83239c312076/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:13.155645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83057a-2dfd-42fd-a17b-15496c6e421a admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:13.165882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83057a-2dfd-42fd-a17b-15496c6e421a admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:13.185199 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:13.222934 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8818eb9-9c07-492e-841c-18c15b38822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:13.223604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818eb9-9c07-492e-841c-18c15b38822b admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:13.223893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818eb9-9c07-492e-841c-18c15b38822b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:13.224175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818eb9-9c07-492e-841c-18c15b38822b admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:13.224897 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8818eb9-9c07-492e-841c-18c15b38822b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:13.226497 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8818eb9-9c07-492e-841c-18c15b38822b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:13.236117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1356/2698] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:13.240394 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a875b-7b1d-4918-a57c-d1891fb5c2d2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:13.245942 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:13.252999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a875b-7b1d-4918-a57c-d1891fb5c2d2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:13.257767 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:13.258663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:13.259051 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:13.259338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] PATH_INFO: `/v3/projects/e5470a3d58da4d1bbf89efafd2133460/users/b162ed78907544b7bc0d83239c312076/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:13.261334 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5470a3d58da4d1bbf89efafd2133460, user_id=b162ed78907544b7bc0d83239c312076, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:13.264016 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:13.275352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1343/2699] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:40:13 2022] PUT /identity/v3/projects/e5470a3d58da4d1bbf89efafd2133460/users/b162ed78907544b7bc0d83239c312076/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:13.285253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8831ef-2b72-4f95-a63e-53d1c3217c11 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:13.285688 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8831ef-2b72-4f95-a63e-53d1c3217c11 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:13.285818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8831ef-2b72-4f95-a63e-53d1c3217c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:13.311346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4b8831ef-2b72-4f95-a63e-53d1c3217c11 None None] MFA Rules not processed for user `b162ed78907544b7bc0d83239c312076`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:13.313291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4b8831ef-2b72-4f95-a63e-53d1c3217c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:13.380795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1357/2700] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:13.392562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:13.394260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:13.450545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583f149-f9a9-427a-a385-10964c5b1890 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:13.454575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cd622-e641-4032-97e8-d8a22c7b9ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:13.455244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd622-e641-4032-97e8-d8a22c7b9ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:13.455531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd622-e641-4032-97e8-d8a22c7b9ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:13.455808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd622-e641-4032-97e8-d8a22c7b9ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:13.464545 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cd622-e641-4032-97e8-d8a22c7b9ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:13.465965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cd622-e641-4032-97e8-d8a22c7b9ce9 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:13.475433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1344/2701] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:13.518153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8831ef-2b72-4f95-a63e-53d1c3217c11 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:13.519625 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4b8831ef-2b72-4f95-a63e-53d1c3217c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:13.531500 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8831ef-2b72-4f95-a63e-53d1c3217c11 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:13.535309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13aeba-fa37-4929-81f1-c4dca30fce25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:13.536048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13aeba-fa37-4929-81f1-c4dca30fce25 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:13.536335 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13aeba-fa37-4929-81f1-c4dca30fce25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:13.536613 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13aeba-fa37-4929-81f1-c4dca30fce25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:13.594977 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13aeba-fa37-4929-81f1-c4dca30fce25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:13.596245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13aeba-fa37-4929-81f1-c4dca30fce25 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:13.606959 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1358/2702] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:16.868506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cd622-e641-4032-97e8-d8a22c7b9ce9 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:16.929634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cd622-e641-4032-97e8-d8a22c7b9ce9 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:16.934208 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:16.935101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:16.935393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:16.935671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] PATH_INFO: `/v3/users/36d46faf7c734bf7ba7783a02810f981` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:16.936841 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d46faf7c734bf7ba7783a02810f981)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:16.939388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:16.983078 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d46faf7c734bf7ba7783a02810f981'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:16.983749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d46faf7c734bf7ba7783a02810f981'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:16.991355 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d46faf7c734bf7ba7783a02810f981'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:16.998153 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d46faf7c734bf7ba7783a02810f981'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.009709 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d46faf7c734bf7ba7783a02810f981'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.015553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1345/2703] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:16 2022] DELETE /identity/v3/users/36d46faf7c734bf7ba7783a02810f981 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:17.020006 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ab42-9238-42f5-a4d7-079064d6dc73 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:17.020484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ab42-9238-42f5-a4d7-079064d6dc73 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:17.020580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ab42-9238-42f5-a4d7-079064d6dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:17.038000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-eef8ab42-9238-42f5-a4d7-079064d6dc73 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:17.039239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eef8ab42-9238-42f5-a4d7-079064d6dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:17.079741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=100 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:17.099818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1359/2704] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:17.110306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:17.111658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:17.124852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:17.170486 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821e9a-6f36-4281-aa3e-60042f8df4d6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:17.174454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0bac-4cbd-4dfb-9c1f-d3726014907d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:17.175142 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0bac-4cbd-4dfb-9c1f-d3726014907d service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:17.175782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0bac-4cbd-4dfb-9c1f-d3726014907d service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:17.175782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0bac-4cbd-4dfb-9c1f-d3726014907d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:17.185111 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c0bac-4cbd-4dfb-9c1f-d3726014907d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:17.186548 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c0bac-4cbd-4dfb-9c1f-d3726014907d service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:17.196825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1346/2705] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:17.462183 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8ab42-9238-42f5-a4d7-079064d6dc73 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:17.463667 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eef8ab42-9238-42f5-a4d7-079064d6dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:17.475619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8ab42-9238-42f5-a4d7-079064d6dc73 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:17.483205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:17.484113 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:17.484922 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:17.485201 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] PATH_INFO: `/v3/projects/5165e3fa744c4804a84015fcf5ad28a6` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:17.486525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5165e3fa744c4804a84015fcf5ad28a6)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:17.488478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:17.534750 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5165e3fa744c4804a84015fcf5ad28a6', 'request_id': 'req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.540424 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5165e3fa744c4804a84015fcf5ad28a6', 'request_id': 'req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.547663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5165e3fa744c4804a84015fcf5ad28a6', 'request_id': 'req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.559600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] The token cache is being invalidate because project 5165e3fa744c4804a84015fcf5ad28a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:17.559892 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.560506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.562021 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1360/2706] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:17 2022] DELETE /identity/v3/projects/5165e3fa744c4804a84015fcf5ad28a6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:17.566628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0bac-4cbd-4dfb-9c1f-d3726014907d service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:17.576259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0bac-4cbd-4dfb-9c1f-d3726014907d service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:17.631277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:17.632148 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:17.632435 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:17.632715 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] PATH_INFO: `/v3/users/b162ed78907544b7bc0d83239c312076` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:17.633870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b162ed78907544b7bc0d83239c312076)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:17.635824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:17.680292 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b162ed78907544b7bc0d83239c312076'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.680930 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b162ed78907544b7bc0d83239c312076'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.688746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b162ed78907544b7bc0d83239c312076'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.695494 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b162ed78907544b7bc0d83239c312076'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.707019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f0894a23-6715-48ad-b384-3a5ec6dba331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b162ed78907544b7bc0d83239c312076'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:17.712732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1347/2707] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:17 2022] DELETE /identity/v3/users/b162ed78907544b7bc0d83239c312076 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:17.988225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:17.989659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:18.003859 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983cc06-fa4f-48d6-92e7-b46cc2c58b66 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.061297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.062179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.062512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.062815 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] PATH_INFO: `/v3/projects/e5470a3d58da4d1bbf89efafd2133460` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.064014 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5470a3d58da4d1bbf89efafd2133460)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.065946 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.112784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5470a3d58da4d1bbf89efafd2133460', 'request_id': 'req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:18.118162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5470a3d58da4d1bbf89efafd2133460', 'request_id': 'req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:18.124076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5470a3d58da4d1bbf89efafd2133460', 'request_id': 'req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:18.131862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:18.136893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] The token cache is being invalidate because project e5470a3d58da4d1bbf89efafd2133460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:18.137359 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:18.138675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-7e6490ee-1f03-487b-bdf3-22bf7fad22ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:18.141338 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1361/2708] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:17 2022] DELETE /identity/v3/projects/e5470a3d58da4d1bbf89efafd2133460 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:18.145918 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f9ecc-8c93-4871-a805-db50f4a19a03 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.146388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f9ecc-8c93-4871-a805-db50f4a19a03 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.146805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f9ecc-8c93-4871-a805-db50f4a19a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.166820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-175f9ecc-8c93-4871-a805-db50f4a19a03 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:18.168011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-175f9ecc-8c93-4871-a805-db50f4a19a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:18.195940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:18.229431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1348/2709] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:18.238192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70291-37e3-4020-aeb0-9538b9489acc None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.238494 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70291-37e3-4020-aeb0-9538b9489acc None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.238802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70291-37e3-4020-aeb0-9538b9489acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.256575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b5a70291-37e3-4020-aeb0-9538b9489acc None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:18.257780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b5a70291-37e3-4020-aeb0-9538b9489acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:18.266228 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1362/2710] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:18.270314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f9ecc-8c93-4871-a805-db50f4a19a03 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.279758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f9ecc-8c93-4871-a805-db50f4a19a03 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.284781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.285431 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.285718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.285999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.286721 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:40:18.287069 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.288647 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.300042 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1349/2711] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:40:18.304008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a70291-37e3-4020-aeb0-9538b9489acc None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.312987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a70291-37e3-4020-aeb0-9538b9489acc None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.317542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a522909-c0dc-4251-acb1-513c7d6dc5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.318192 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a522909-c0dc-4251-acb1-513c7d6dc5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.318478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a522909-c0dc-4251-acb1-513c7d6dc5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.318757 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a522909-c0dc-4251-acb1-513c7d6dc5d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.319474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a522909-c0dc-4251-acb1-513c7d6dc5d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.321364 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a522909-c0dc-4251-acb1-513c7d6dc5d1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.346920 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1363/2712] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:40:18 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:40:18.350765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.360588 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c98ab4-098f-4e71-b43d-c157a1a6061b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.417074 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cc3c7-be78-45ba-b555-85f1d20480e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.418079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc3c7-be78-45ba-b555-85f1d20480e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.418332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc3c7-be78-45ba-b555-85f1d20480e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.418670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc3c7-be78-45ba-b555-85f1d20480e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.419499 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cc3c7-be78-45ba-b555-85f1d20480e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.421906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cc3c7-be78-45ba-b555-85f1d20480e4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.442090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1350/2713] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:40:18 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:18.446399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a522909-c0dc-4251-acb1-513c7d6dc5d1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.457290 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a522909-c0dc-4251-acb1-513c7d6dc5d1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.462034 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81b33-67f9-4c20-8d49-c0d301899bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.462720 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81b33-67f9-4c20-8d49-c0d301899bef admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.463134 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81b33-67f9-4c20-8d49-c0d301899bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.463419 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81b33-67f9-4c20-8d49-c0d301899bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.464186 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e81b33-67f9-4c20-8d49-c0d301899bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.465796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e81b33-67f9-4c20-8d49-c0d301899bef admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.477305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1364/2714] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:18.481269 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cc3c7-be78-45ba-b555-85f1d20480e4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.491529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cc3c7-be78-45ba-b555-85f1d20480e4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.496434 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0318f4-58d3-402f-8f11-e14bf130883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.497110 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0318f4-58d3-402f-8f11-e14bf130883a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.497406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0318f4-58d3-402f-8f11-e14bf130883a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.497691 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0318f4-58d3-402f-8f11-e14bf130883a admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.498429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0318f4-58d3-402f-8f11-e14bf130883a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.500576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0318f4-58d3-402f-8f11-e14bf130883a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.510874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1351/2715] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:18.514878 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81b33-67f9-4c20-8d49-c0d301899bef admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.525287 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81b33-67f9-4c20-8d49-c0d301899bef admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.529809 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8a561-5fb5-4604-ad4e-157a90a4a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.530686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8a561-5fb5-4604-ad4e-157a90a4a720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.531007 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8a561-5fb5-4604-ad4e-157a90a4a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.531288 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8a561-5fb5-4604-ad4e-157a90a4a720 admin admin] PATH_INFO: `/v3/projects/f4e32b8d7de24b1b83dd30b4fd63cc87/users/3c600b6d69d14f39b8286f67eb2fcf67/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.545435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8a561-5fb5-4604-ad4e-157a90a4a720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e32b8d7de24b1b83dd30b4fd63cc87, user_id=3c600b6d69d14f39b8286f67eb2fcf67, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.548356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8a561-5fb5-4604-ad4e-157a90a4a720 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.561305 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1365/2716] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:40:18 2022] PUT /identity/v3/projects/f4e32b8d7de24b1b83dd30b4fd63cc87/users/3c600b6d69d14f39b8286f67eb2fcf67/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:18.572003 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188aff3-3921-4da5-85f3-e06a5ad7c4ba None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.572304 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188aff3-3921-4da5-85f3-e06a5ad7c4ba None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.572592 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188aff3-3921-4da5-85f3-e06a5ad7c4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.598925 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2188aff3-3921-4da5-85f3-e06a5ad7c4ba None None] MFA Rules not processed for user `3c600b6d69d14f39b8286f67eb2fcf67`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:18.600177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2188aff3-3921-4da5-85f3-e06a5ad7c4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:18.663251 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1352/2717] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:18.667872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8a561-5fb5-4604-ad4e-157a90a4a720 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.729501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8a561-5fb5-4604-ad4e-157a90a4a720 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.733989 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c8749-fd63-42a0-9271-46a9df63ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.734647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c8749-fd63-42a0-9271-46a9df63ac7c admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.734966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c8749-fd63-42a0-9271-46a9df63ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.735249 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c8749-fd63-42a0-9271-46a9df63ac7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.735927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c8749-fd63-42a0-9271-46a9df63ac7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.737836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c8749-fd63-42a0-9271-46a9df63ac7c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.762385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1366/2718] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:40:18 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:18.767134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188aff3-3921-4da5-85f3-e06a5ad7c4ba None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.777610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188aff3-3921-4da5-85f3-e06a5ad7c4ba None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.802505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:18.834062 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588e73-82cc-4d06-a3f2-97122414a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.834739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588e73-82cc-4d06-a3f2-97122414a0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.835073 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588e73-82cc-4d06-a3f2-97122414a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.835388 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588e73-82cc-4d06-a3f2-97122414a0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.836082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588e73-82cc-4d06-a3f2-97122414a0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.837998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588e73-82cc-4d06-a3f2-97122414a0c4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.856719 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1353/2719] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:40:18 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:18.861310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c8749-fd63-42a0-9271-46a9df63ac7c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.871592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c8749-fd63-42a0-9271-46a9df63ac7c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.876872 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7e3c4-05c1-4373-9712-96df2bfebc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.877538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e3c4-05c1-4373-9712-96df2bfebc4e admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.877828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e3c4-05c1-4373-9712-96df2bfebc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.878109 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e3c4-05c1-4373-9712-96df2bfebc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.878868 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e3c4-05c1-4373-9712-96df2bfebc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.880473 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e3c4-05c1-4373-9712-96df2bfebc4e admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.891000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1367/2720] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:18.895060 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588e73-82cc-4d06-a3f2-97122414a0c4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.905102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588e73-82cc-4d06-a3f2-97122414a0c4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:18.910260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c67be-0abd-41b0-b1a6-0207134b7932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:18.911193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c67be-0abd-41b0-b1a6-0207134b7932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:18.911515 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c67be-0abd-41b0-b1a6-0207134b7932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:18.911794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c67be-0abd-41b0-b1a6-0207134b7932 admin admin] PATH_INFO: `/v3/projects/81352ebffffd46b88077cf4f1ecbf087/users/0a843c81ab90445fb5bec5a1c1ac268a/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:18.927095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c67be-0abd-41b0-b1a6-0207134b7932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81352ebffffd46b88077cf4f1ecbf087, user_id=0a843c81ab90445fb5bec5a1c1ac268a, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:18.929745 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c67be-0abd-41b0-b1a6-0207134b7932 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:18.942885 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1354/2721] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:40:18 2022] PUT /identity/v3/projects/81352ebffffd46b88077cf4f1ecbf087/users/0a843c81ab90445fb5bec5a1c1ac268a/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:40:18.947020 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7e3c4-05c1-4373-9712-96df2bfebc4e admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:18.957204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7e3c4-05c1-4373-9712-96df2bfebc4e admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:19.011178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e6145-682d-44f5-91d5-e4ed0c0ed676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:19.011780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e6145-682d-44f5-91d5-e4ed0c0ed676 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:19.012071 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e6145-682d-44f5-91d5-e4ed0c0ed676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:19.012353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e6145-682d-44f5-91d5-e4ed0c0ed676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:19.013072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e6145-682d-44f5-91d5-e4ed0c0ed676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:19.014666 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e6145-682d-44f5-91d5-e4ed0c0ed676 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:19.024165 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1368/2722] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:19.028187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c67be-0abd-41b0-b1a6-0207134b7932 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:19.038424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c67be-0abd-41b0-b1a6-0207134b7932 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:19.043084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:19.044001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:19.044289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:19.044572 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] PATH_INFO: `/v3/projects/81352ebffffd46b88077cf4f1ecbf087/users/0a843c81ab90445fb5bec5a1c1ac268a/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:19.046846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=81352ebffffd46b88077cf4f1ecbf087, user_id=0a843c81ab90445fb5bec5a1c1ac268a, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:19.050061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:19.060688 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1355/2723] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:40:19 2022] PUT /identity/v3/projects/81352ebffffd46b88077cf4f1ecbf087/users/0a843c81ab90445fb5bec5a1c1ac268a/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:19.072327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b8b34-f904-4b28-9556-a1ab2b7e9e6e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:19.072772 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b8b34-f904-4b28-9556-a1ab2b7e9e6e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:19.072895 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b8b34-f904-4b28-9556-a1ab2b7e9e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:19.079607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:19.100266 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-8b6b8b34-f904-4b28-9556-a1ab2b7e9e6e None None] MFA Rules not processed for user `0a843c81ab90445fb5bec5a1c1ac268a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:19.101531 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8b6b8b34-f904-4b28-9556-a1ab2b7e9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:19.169447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1369/2724] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:19.181462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:19.183297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:19.241466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2904a96-aac4-49a3-9af7-10ab001d6aae admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:19.245143 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71957691-3908-4ebc-964a-c8fe16def564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:19.245846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71957691-3908-4ebc-964a-c8fe16def564 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:19.246422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71957691-3908-4ebc-964a-c8fe16def564 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:19.246422 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71957691-3908-4ebc-964a-c8fe16def564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:19.255502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71957691-3908-4ebc-964a-c8fe16def564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:19.256946 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71957691-3908-4ebc-964a-c8fe16def564 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:19.266534 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1356/2725] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:19.335654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b8b34-f904-4b28-9556-a1ab2b7e9e6e None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:19.345552 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b8b34-f904-4b28-9556-a1ab2b7e9e6e None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:19.349117 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6abe08-0ce3-4c0f-8c26-a0e569bf5e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:19.349751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abe08-0ce3-4c0f-8c26-a0e569bf5e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:19.350037 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abe08-0ce3-4c0f-8c26-a0e569bf5e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:19.350314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abe08-0ce3-4c0f-8c26-a0e569bf5e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:19.404254 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6abe08-0ce3-4c0f-8c26-a0e569bf5e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:19.405686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6abe08-0ce3-4c0f-8c26-a0e569bf5e88 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:19.414861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1370/2726] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:19.682316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71957691-3908-4ebc-964a-c8fe16def564 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:19.742481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71957691-3908-4ebc-964a-c8fe16def564 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:19.747574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:19.748466 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:19.748755 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:19.749032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] PATH_INFO: `/v3/users/3c600b6d69d14f39b8286f67eb2fcf67` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:19.750199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c600b6d69d14f39b8286f67eb2fcf67)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:19.752262 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:19.779541 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:19.799077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c600b6d69d14f39b8286f67eb2fcf67'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:19.799732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c600b6d69d14f39b8286f67eb2fcf67'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:19.806915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c600b6d69d14f39b8286f67eb2fcf67'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:19.813822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c600b6d69d14f39b8286f67eb2fcf67'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:19.825310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c600b6d69d14f39b8286f67eb2fcf67'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:19.831601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1357/2727] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:19 2022] DELETE /identity/v3/users/3c600b6d69d14f39b8286f67eb2fcf67 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:19.836083 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddacf6-07eb-48de-a386-70953ee02f39 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:19.836386 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddacf6-07eb-48de-a386-70953ee02f39 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:19.836674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddacf6-07eb-48de-a386-70953ee02f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:19.854882 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-4dddacf6-07eb-48de-a386-70953ee02f39 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:19.856105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4dddacf6-07eb-48de-a386-70953ee02f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:19.914845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1371/2728] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:40:19.924497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:19.925882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:19.984198 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81432b1-0667-48e6-87c5-0f25e489fbdb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:19.987857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4344ee6-eefb-4410-a215-f08fce18f027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:19.988513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4344ee6-eefb-4410-a215-f08fce18f027 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:19.988806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4344ee6-eefb-4410-a215-f08fce18f027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:19.989095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4344ee6-eefb-4410-a215-f08fce18f027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:19.997997 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4344ee6-eefb-4410-a215-f08fce18f027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:19.999463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4344ee6-eefb-4410-a215-f08fce18f027 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:20.009410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1358/2729] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:20.264145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddacf6-07eb-48de-a386-70953ee02f39 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:20.265609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-4dddacf6-07eb-48de-a386-70953ee02f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:20.281460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddacf6-07eb-48de-a386-70953ee02f39 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:20.286377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:20.287279 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:20.287589 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:20.287940 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] PATH_INFO: `/v3/projects/f4e32b8d7de24b1b83dd30b4fd63cc87` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:20.289100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e32b8d7de24b1b83dd30b4fd63cc87)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:20.290984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:20.317145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:20.340053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e32b8d7de24b1b83dd30b4fd63cc87', 'request_id': 'req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.345624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e32b8d7de24b1b83dd30b4fd63cc87', 'request_id': 'req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.351687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e32b8d7de24b1b83dd30b4fd63cc87', 'request_id': 'req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.364499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] The token cache is being invalidate because project f4e32b8d7de24b1b83dd30b4fd63cc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:20.364790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.365408 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.366957 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1372/2730] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:20 2022] DELETE /identity/v3/projects/f4e32b8d7de24b1b83dd30b4fd63cc87 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:20.370907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4344ee6-eefb-4410-a215-f08fce18f027 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:20.381026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4344ee6-eefb-4410-a215-f08fce18f027 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:20.436267 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:20.437141 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:20.437426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:20.437703 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] PATH_INFO: `/v3/users/0a843c81ab90445fb5bec5a1c1ac268a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:20.439460 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a843c81ab90445fb5bec5a1c1ac268a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:20.441373 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:20.485424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a843c81ab90445fb5bec5a1c1ac268a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.486076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a843c81ab90445fb5bec5a1c1ac268a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.487757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:20.493869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a843c81ab90445fb5bec5a1c1ac268a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.501875 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a843c81ab90445fb5bec5a1c1ac268a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.513416 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8dab3d73-9a2b-4d63-a9d1-51767aef2be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a843c81ab90445fb5bec5a1c1ac268a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.519353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1359/2731] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:20 2022] DELETE /identity/v3/users/0a843c81ab90445fb5bec5a1c1ac268a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:20.785978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:20.787459 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:20.815197 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c73c7-9efd-4c59-bc48-fb133a6c2beb admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:20.875010 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:20.875850 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:20.876315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:20.876597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] PATH_INFO: `/v3/projects/81352ebffffd46b88077cf4f1ecbf087` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:20.877849 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81352ebffffd46b88077cf4f1ecbf087)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:20.879823 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:20.930105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81352ebffffd46b88077cf4f1ecbf087', 'request_id': 'req-1761c31c-9553-4159-95c6-7515869fc221'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.935733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81352ebffffd46b88077cf4f1ecbf087', 'request_id': 'req-1761c31c-9553-4159-95c6-7515869fc221'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.943219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81352ebffffd46b88077cf4f1ecbf087', 'request_id': 'req-1761c31c-9553-4159-95c6-7515869fc221'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.958377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] The token cache is being invalidate because project 81352ebffffd46b88077cf4f1ecbf087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:20.958668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.959371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1761c31c-9553-4159-95c6-7515869fc221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:20.960910 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1373/2732] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:20 2022] DELETE /identity/v3/projects/81352ebffffd46b88077cf4f1ecbf087 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:20.965880 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804033-f5a0-43fc-9508-a6eaf47cb2d8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:20.966247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804033-f5a0-43fc-9508-a6eaf47cb2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:20.966596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804033-f5a0-43fc-9508-a6eaf47cb2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:20.986620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3e804033-f5a0-43fc-9508-a6eaf47cb2d8 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:20.987967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3e804033-f5a0-43fc-9508-a6eaf47cb2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:21.054913 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1360/2733] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:21.062467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afdf84-5b92-4e9a-8f96-e49cb191381c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.062759 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afdf84-5b92-4e9a-8f96-e49cb191381c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.063115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afdf84-5b92-4e9a-8f96-e49cb191381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.081773 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-70afdf84-5b92-4e9a-8f96-e49cb191381c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:21.083026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-70afdf84-5b92-4e9a-8f96-e49cb191381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:21.090802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1374/2734] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:21.095819 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804033-f5a0-43fc-9508-a6eaf47cb2d8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:21.105663 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804033-f5a0-43fc-9508-a6eaf47cb2d8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:21.110891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:21.111561 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.111853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.112134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.112866 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:40:21.113180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:21.114803 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:21.126664 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1361/2735] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:40:21.130962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afdf84-5b92-4e9a-8f96-e49cb191381c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:21.140219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afdf84-5b92-4e9a-8f96-e49cb191381c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:21.145429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c44b-c64a-43dc-b677-2650b2f3bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:21.146079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c44b-c64a-43dc-b677-2650b2f3bc3d admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.146367 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c44b-c64a-43dc-b677-2650b2f3bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.146645 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c44b-c64a-43dc-b677-2650b2f3bc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.147369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838c44b-c64a-43dc-b677-2650b2f3bc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:21.149276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838c44b-c64a-43dc-b677-2650b2f3bc3d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:21.174306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1375/2736] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:40:21 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:21.178336 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:21.188197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afadde3-5dbc-4641-bb54-3684fcc19144 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:21.245882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edc9a2-06e9-4872-a3e4-bbc1eda9efa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:21.246635 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edc9a2-06e9-4872-a3e4-bbc1eda9efa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.246956 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edc9a2-06e9-4872-a3e4-bbc1eda9efa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.247241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edc9a2-06e9-4872-a3e4-bbc1eda9efa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.247933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edc9a2-06e9-4872-a3e4-bbc1eda9efa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:21.249874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edc9a2-06e9-4872-a3e4-bbc1eda9efa9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:21.273941 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1362/2737] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:40:21 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:40:21.277990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c44b-c64a-43dc-b677-2650b2f3bc3d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:21.289077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c44b-c64a-43dc-b677-2650b2f3bc3d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:21.293828 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be3868-8b90-4388-a00e-8fe4a2b79a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:21.294503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3868-8b90-4388-a00e-8fe4a2b79a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.294824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3868-8b90-4388-a00e-8fe4a2b79a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.295115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3868-8b90-4388-a00e-8fe4a2b79a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.296144 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be3868-8b90-4388-a00e-8fe4a2b79a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:21.297753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be3868-8b90-4388-a00e-8fe4a2b79a16 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:21.308256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1376/2738] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:21.312215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edc9a2-06e9-4872-a3e4-bbc1eda9efa9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:21.322268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edc9a2-06e9-4872-a3e4-bbc1eda9efa9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:21.326895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff4e9b-e67d-416e-a09c-043d9557c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:21.327558 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4e9b-e67d-416e-a09c-043d9557c134 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.327848 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4e9b-e67d-416e-a09c-043d9557c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.328128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4e9b-e67d-416e-a09c-043d9557c134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.329356 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff4e9b-e67d-416e-a09c-043d9557c134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:21.330981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff4e9b-e67d-416e-a09c-043d9557c134 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:21.340758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1363/2739] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:21.345323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be3868-8b90-4388-a00e-8fe4a2b79a16 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:21.350515 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:21.356481 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be3868-8b90-4388-a00e-8fe4a2b79a16 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:21.362238 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:21.363171 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.363454 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.363728 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] PATH_INFO: `/v3/projects/b21c2b5eedc54ef3a474032977c345e8/users/1cd85f1987d34f5c830039665f7100af/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.378257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21c2b5eedc54ef3a474032977c345e8, user_id=1cd85f1987d34f5c830039665f7100af, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:21.380900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:21.396712 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1377/2740] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:40:21 2022] PUT /identity/v3/projects/b21c2b5eedc54ef3a474032977c345e8/users/1cd85f1987d34f5c830039665f7100af/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:21.407694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7de829-cb21-43c6-9556-9ca8b9ff23f8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.409711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7de829-cb21-43c6-9556-9ca8b9ff23f8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.409711 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7de829-cb21-43c6-9556-9ca8b9ff23f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.435370 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5d7de829-cb21-43c6-9556-9ca8b9ff23f8 None None] MFA Rules not processed for user `1cd85f1987d34f5c830039665f7100af`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:21.436600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5d7de829-cb21-43c6-9556-9ca8b9ff23f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:21.455607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:21.503145 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1364/2741] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:21.514343 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:21.516258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:21.572551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d84b-ddac-4833-8cef-be2ab5fe8e88 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:21.576195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81511510-3c32-450a-bc5f-c052871b3654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:21.576830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511510-3c32-450a-bc5f-c052871b3654 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:21.577112 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511510-3c32-450a-bc5f-c052871b3654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:21.577388 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81511510-3c32-450a-bc5f-c052871b3654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:21.586325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81511510-3c32-450a-bc5f-c052871b3654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:21.587808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81511510-3c32-450a-bc5f-c052871b3654 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:21.596846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1378/2742] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:27.628272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7de829-cb21-43c6-9556-9ca8b9ff23f8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:27.630282 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5d7de829-cb21-43c6-9556-9ca8b9ff23f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:27.715149 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7de829-cb21-43c6-9556-9ca8b9ff23f8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:27.721764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618b2b2-a6b9-4bd3-9246-327a84b7e3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:27.722485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b2b2-a6b9-4bd3-9246-327a84b7e3a9 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:27.722714 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b2b2-a6b9-4bd3-9246-327a84b7e3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:27.723032 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b2b2-a6b9-4bd3-9246-327a84b7e3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:27.724824 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a618b2b2-a6b9-4bd3-9246-327a84b7e3a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:27.738040 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618b2b2-a6b9-4bd3-9246-327a84b7e3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:27.739658 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618b2b2-a6b9-4bd3-9246-327a84b7e3a9 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:27.752797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1365/2743] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:31.592797 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:33.002447 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81511510-3c32-450a-bc5f-c052871b3654 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:33.081633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81511510-3c32-450a-bc5f-c052871b3654 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:33.086607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:33.087554 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:33.087842 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:33.088123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] PATH_INFO: `/v3/users/1cd85f1987d34f5c830039665f7100af` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:33.089372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd85f1987d34f5c830039665f7100af)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:33.091337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:33.147512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd85f1987d34f5c830039665f7100af'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.163130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd85f1987d34f5c830039665f7100af'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.164829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd85f1987d34f5c830039665f7100af'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.179887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd85f1987d34f5c830039665f7100af'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.188528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd85f1987d34f5c830039665f7100af'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.196088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1379/2744] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:33 2022] DELETE /identity/v3/users/1cd85f1987d34f5c830039665f7100af => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:33.201912 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ae46-a2de-4951-a0d0-31e9d6fc36fe None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:33.202450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ae46-a2de-4951-a0d0-31e9d6fc36fe None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:33.202741 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ae46-a2de-4951-a0d0-31e9d6fc36fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:33.223766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-acf7ae46-a2de-4951-a0d0-31e9d6fc36fe None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:33.225001 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-acf7ae46-a2de-4951-a0d0-31e9d6fc36fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:33.310933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1366/2745] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:33.318174 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:33.319881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:33.399966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef78ac-2642-4ee4-9fb7-6c5d92e7b85d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:33.403695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763cbf0-f6a0-4a81-9668-7e19eedf45ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:33.404371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763cbf0-f6a0-4a81-9668-7e19eedf45ac service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:33.404664 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763cbf0-f6a0-4a81-9668-7e19eedf45ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:33.404947 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763cbf0-f6a0-4a81-9668-7e19eedf45ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:33.415840 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763cbf0-f6a0-4a81-9668-7e19eedf45ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:33.417319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763cbf0-f6a0-4a81-9668-7e19eedf45ac service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:33.428987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1380/2746] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:33.731182 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7ae46-a2de-4951-a0d0-31e9d6fc36fe None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:33.732728 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-acf7ae46-a2de-4951-a0d0-31e9d6fc36fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:33.745241 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7ae46-a2de-4951-a0d0-31e9d6fc36fe None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:33.750035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:33.750959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:33.751250 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:33.751529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] PATH_INFO: `/v3/projects/b21c2b5eedc54ef3a474032977c345e8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:33.753454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21c2b5eedc54ef3a474032977c345e8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:33.755420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:33.802805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:33.811171 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21c2b5eedc54ef3a474032977c345e8', 'request_id': 'req-bef91c0a-3cdd-4755-83b0-0124364e448b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.818661 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21c2b5eedc54ef3a474032977c345e8', 'request_id': 'req-bef91c0a-3cdd-4755-83b0-0124364e448b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.824363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21c2b5eedc54ef3a474032977c345e8', 'request_id': 'req-bef91c0a-3cdd-4755-83b0-0124364e448b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.838279 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] The token cache is being invalidate because project b21c2b5eedc54ef3a474032977c345e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:33.838577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.839247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bef91c0a-3cdd-4755-83b0-0124364e448b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:33.840806 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1367/2747] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:33 2022] DELETE /identity/v3/projects/b21c2b5eedc54ef3a474032977c345e8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:33.846564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de699d-035b-426e-94a7-b22415388b68 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:33.846885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de699d-035b-426e-94a7-b22415388b68 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:33.847172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de699d-035b-426e-94a7-b22415388b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:33.866380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-44de699d-035b-426e-94a7-b22415388b68 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:33.867659 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-44de699d-035b-426e-94a7-b22415388b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:33.886509 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:33.933733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1381/2748] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:33.997195 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb296-dae9-41c6-8d74-8971d81fec07 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:33.997497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb296-dae9-41c6-8d74-8971d81fec07 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:33.997786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb296-dae9-41c6-8d74-8971d81fec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.027520 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-942fb296-dae9-41c6-8d74-8971d81fec07 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:34.028947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-942fb296-dae9-41c6-8d74-8971d81fec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:34.041712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1368/2749] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:34.046140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de699d-035b-426e-94a7-b22415388b68 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.057761 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de699d-035b-426e-94a7-b22415388b68 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:34.066860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:34.068811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.069158 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.069444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.070204 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:40:34.070525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:34.072211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:34.085950 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1382/2750] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:40:34.090427 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fb296-dae9-41c6-8d74-8971d81fec07 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.100853 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fb296-dae9-41c6-8d74-8971d81fec07 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:34.105852 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03abcb-b2ab-42c8-92f4-410e28ce1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:34.106529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03abcb-b2ab-42c8-92f4-410e28ce1492 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.106906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03abcb-b2ab-42c8-92f4-410e28ce1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.107188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03abcb-b2ab-42c8-92f4-410e28ce1492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.107891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03abcb-b2ab-42c8-92f4-410e28ce1492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:34.109792 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03abcb-b2ab-42c8-92f4-410e28ce1492 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:34.141902 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1369/2751] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:40:34 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:40:34.146325 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.156686 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02571e-922f-4b08-bf2a-af57e46c3e52 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:34.216525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda567-b15f-467b-bb3e-8907a621defd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:34.217202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda567-b15f-467b-bb3e-8907a621defd admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.217551 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda567-b15f-467b-bb3e-8907a621defd admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.217835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda567-b15f-467b-bb3e-8907a621defd admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.218514 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dda567-b15f-467b-bb3e-8907a621defd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:34.220450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dda567-b15f-467b-bb3e-8907a621defd admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:34.242160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1383/2752] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:40:34 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:40:34.246349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03abcb-b2ab-42c8-92f4-410e28ce1492 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.256833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03abcb-b2ab-42c8-92f4-410e28ce1492 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:34.262414 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94843edd-9f73-4e2c-8715-e4c3a047e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:34.263131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94843edd-9f73-4e2c-8715-e4c3a047e902 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.263552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94843edd-9f73-4e2c-8715-e4c3a047e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.263702 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94843edd-9f73-4e2c-8715-e4c3a047e902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.264478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94843edd-9f73-4e2c-8715-e4c3a047e902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:34.266135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94843edd-9f73-4e2c-8715-e4c3a047e902 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:34.278478 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1370/2753] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:34.282542 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda567-b15f-467b-bb3e-8907a621defd admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.293101 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda567-b15f-467b-bb3e-8907a621defd admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:34.297979 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d19c0-d404-40f5-8004-10da5e287abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:34.301453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d19c0-d404-40f5-8004-10da5e287abb admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.301453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d19c0-d404-40f5-8004-10da5e287abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.301453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d19c0-d404-40f5-8004-10da5e287abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.301453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d19c0-d404-40f5-8004-10da5e287abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:34.302128 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d19c0-d404-40f5-8004-10da5e287abb admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:34.313987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1384/2754] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:40:34.318124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94843edd-9f73-4e2c-8715-e4c3a047e902 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.329316 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94843edd-9f73-4e2c-8715-e4c3a047e902 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:34.334193 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:34.335122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.335409 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.335685 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] PATH_INFO: `/v3/projects/6e7fcb908cee4c18b28744ffad08cfce/users/5a02c58a5e6744f289ae6882ec8171be/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.352765 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7fcb908cee4c18b28744ffad08cfce, user_id=5a02c58a5e6744f289ae6882ec8171be, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:34.365125 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:34.379684 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1371/2755] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:40:34 2022] PUT /identity/v3/projects/6e7fcb908cee4c18b28744ffad08cfce/users/5a02c58a5e6744f289ae6882ec8171be/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:34.389651 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a277c-90fb-41da-8b14-67b4d3706c77 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.389881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a277c-90fb-41da-8b14-67b4d3706c77 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.390168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a277c-90fb-41da-8b14-67b4d3706c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.420294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-e19a277c-90fb-41da-8b14-67b4d3706c77 None None] MFA Rules not processed for user `5a02c58a5e6744f289ae6882ec8171be`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:34.421912 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e19a277c-90fb-41da-8b14-67b4d3706c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:34.511835 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1385/2756] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:34.525354 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.527310 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:34.605477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e272fb4-dc04-4968-939e-300b58e7ca56 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:34.609150 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7a558-ab1c-4ba4-8df8-3c5a59aabc9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:34.609990 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a558-ab1c-4ba4-8df8-3c5a59aabc9f service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.610283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a558-ab1c-4ba4-8df8-3c5a59aabc9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.610574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a558-ab1c-4ba4-8df8-3c5a59aabc9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.622011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7a558-ab1c-4ba4-8df8-3c5a59aabc9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:34.623599 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7a558-ab1c-4ba4-8df8-3c5a59aabc9f service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:34.649121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1372/2757] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:34.667647 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a277c-90fb-41da-8b14-67b4d3706c77 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.690706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:34.749888 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a277c-90fb-41da-8b14-67b4d3706c77 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:34.763382 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:34.764302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.764592 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.764927 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] PATH_INFO: `/v3/users/5a02c58a5e6744f289ae6882ec8171be` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.766407 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a02c58a5e6744f289ae6882ec8171be)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:34.769346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:34.852814 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a02c58a5e6744f289ae6882ec8171be'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:34.866726 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a02c58a5e6744f289ae6882ec8171be'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:34.867499 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a02c58a5e6744f289ae6882ec8171be'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:34.877358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a02c58a5e6744f289ae6882ec8171be'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:34.885337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a02c58a5e6744f289ae6882ec8171be'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:34.896094 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1386/2758] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:34 2022] DELETE /identity/v3/users/5a02c58a5e6744f289ae6882ec8171be => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:34.901493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790445c6-77d9-4022-855d-7155508420b3 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:34.901493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790445c6-77d9-4022-855d-7155508420b3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:34.901493 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790445c6-77d9-4022-855d-7155508420b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:34.903896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:34.905693 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:34.921737 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-790445c6-77d9-4022-855d-7155508420b3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:40:34.923071 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-790445c6-77d9-4022-855d-7155508420b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:35.002843 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1373/2759] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:40:35.005195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3b602-2615-40c4-aaac-9792ccab303a admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:35.010270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:35.011493 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:35.011783 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:35.012064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:35.012410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790445c6-77d9-4022-855d-7155508420b3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:35.015162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:35.015352 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-790445c6-77d9-4022-855d-7155508420b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:35.029098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:35.029463 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:35.030700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:35.048619 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1387/2760] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:40:35.090944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790445c6-77d9-4022-855d-7155508420b3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:35.094589 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:35.095274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:35.095562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:35.095877 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:35.109839 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:35.111377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:35.120993 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1374/2761] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:40:35.560702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:35.562191 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:35.576727 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385ae3e-9ebb-44db-83a9-82ff9addda71 service placement] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:35.581467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:35.582347 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:35.582633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:35.582948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] PATH_INFO: `/v3/projects/6e7fcb908cee4c18b28744ffad08cfce` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:35.584172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7fcb908cee4c18b28744ffad08cfce)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:35.586150 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:35.609483 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:35.636663 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7fcb908cee4c18b28744ffad08cfce', 'request_id': 'req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:35.643043 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7fcb908cee4c18b28744ffad08cfce', 'request_id': 'req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:35.649480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7fcb908cee4c18b28744ffad08cfce', 'request_id': 'req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:35.663163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] The token cache is being invalidate because project 6e7fcb908cee4c18b28744ffad08cfce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:35.663458 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:35.664087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:35.666065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1388/2762] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:35 2022] DELETE /identity/v3/projects/6e7fcb908cee4c18b28744ffad08cfce => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:38.015964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:38.017575 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:38.032196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b766d4-c57b-4931-b014-849d2c31a357 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:38.089660 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:38.090553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:38.090882 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:38.091168 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] PATH_INFO: `/v3/users/40ea9ac94d1d4569a2c4620ea18826d1` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:38.092426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ea9ac94d1d4569a2c4620ea18826d1)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:38.094345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:38.142177 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ea9ac94d1d4569a2c4620ea18826d1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.143504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ea9ac94d1d4569a2c4620ea18826d1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.151340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ea9ac94d1d4569a2c4620ea18826d1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.158479 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ea9ac94d1d4569a2c4620ea18826d1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.170603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ea9ac94d1d4569a2c4620ea18826d1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.176910 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1375/2763] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:38 2022] DELETE /identity/v3/users/40ea9ac94d1d4569a2c4620ea18826d1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:38.344214 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:38.345704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:38.358860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf46789-1ae6-43e2-be8c-e83d12c0f2a4 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:38.415966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:38.416836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:38.417123 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:38.417402 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] PATH_INFO: `/v3/projects/c49a99c10f5145f4a73ce1664e23fdb0` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:38.418609 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49a99c10f5145f4a73ce1664e23fdb0)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:38.420553 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:38.465921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49a99c10f5145f4a73ce1664e23fdb0', 'request_id': 'req-59a52c49-b34f-45ab-903d-afe8568422b8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.471448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49a99c10f5145f4a73ce1664e23fdb0', 'request_id': 'req-59a52c49-b34f-45ab-903d-afe8568422b8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.477436 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49a99c10f5145f4a73ce1664e23fdb0', 'request_id': 'req-59a52c49-b34f-45ab-903d-afe8568422b8'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.489380 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] The token cache is being invalidate because project c49a99c10f5145f4a73ce1664e23fdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:38.489670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.490297 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.491838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1389/2764] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:38 2022] DELETE /identity/v3/projects/c49a99c10f5145f4a73ce1664e23fdb0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:38.495924 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:38.497347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:38.510652 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8727f-7648-4ae7-9df9-22317f9ccf8d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:38.538429 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:38.568102 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:38.568984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:38.569273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:38.569553 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] PATH_INFO: `/v3/users/e3cf9d4cc3a84750827e191b21d8d229` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:38.570723 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cf9d4cc3a84750827e191b21d8d229)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:38.572724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:38.616616 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cf9d4cc3a84750827e191b21d8d229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.617210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cf9d4cc3a84750827e191b21d8d229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.624497 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cf9d4cc3a84750827e191b21d8d229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.632092 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cf9d4cc3a84750827e191b21d8d229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.643604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc5fa3e9-b496-412c-804a-7c4cd2e803f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cf9d4cc3a84750827e191b21d8d229'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.649313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1376/2765] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:40:38 2022] DELETE /identity/v3/users/e3cf9d4cc3a84750827e191b21d8d229 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:38.817532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:40:38.818982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:40:38.831939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a52c49-b34f-45ab-903d-afe8568422b8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:40:38.871673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:38.890954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:40:38.891830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:40:38.892116 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:40:38.892391 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] PATH_INFO: `/v3/projects/4326c99d9bda40cabbc0a17e9b97a1f2` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:40:38.893562 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4326c99d9bda40cabbc0a17e9b97a1f2)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:40:38.895529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:40:38.940318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4326c99d9bda40cabbc0a17e9b97a1f2', 'request_id': 'req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.945678 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4326c99d9bda40cabbc0a17e9b97a1f2', 'request_id': 'req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.951561 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4326c99d9bda40cabbc0a17e9b97a1f2', 'request_id': 'req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.964924 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] The token cache is being invalidate because project 4326c99d9bda40cabbc0a17e9b97a1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:40:38.965220 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.965852 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:40:38.967817 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1390/2766] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:40:38 2022] DELETE /identity/v3/projects/4326c99d9bda40cabbc0a17e9b97a1f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:40:48.645894 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:48.961650 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:08.232838 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ba7e-def6-4e92-a44c-34a3881ee3ca None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:08.233337 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ba7e-def6-4e92-a44c-34a3881ee3ca None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:08.233443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ba7e-def6-4e92-a44c-34a3881ee3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:08.250857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-70d2ba7e-def6-4e92-a44c-34a3881ee3ca None None] MFA Rules not processed for user `347a04ca096d4dd7aa8bd7f34430e841`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:08.252077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-70d2ba7e-def6-4e92-a44c-34a3881ee3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:08.307777 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1377/2767] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:18.301009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=25 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:31.232121 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:31.233569 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:31.371839 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d73ccf-aaf7-4ca4-b523-83b7a78047b5 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:31.376956 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:31.377612 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:31.377900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:31.378181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:31.379966 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:31.391668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:31.393250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:31.403708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1391/2768] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:41:41.398836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=63 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:18.493199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ba7e-def6-4e92-a44c-34a3881ee3ca None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:18.494655 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-70d2ba7e-def6-4e92-a44c-34a3881ee3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:18.618076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ba7e-def6-4e92-a44c-34a3881ee3ca None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:18.623134 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:18.624009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.624297 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.624603 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] PATH_INFO: `/v3/users/347a04ca096d4dd7aa8bd7f34430e841` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.625786 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347a04ca096d4dd7aa8bd7f34430e841)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:18.627729 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:18.672739 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347a04ca096d4dd7aa8bd7f34430e841'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.673401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347a04ca096d4dd7aa8bd7f34430e841'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.680456 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347a04ca096d4dd7aa8bd7f34430e841'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.688188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347a04ca096d4dd7aa8bd7f34430e841'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.700083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-e9e30652-e82e-48fc-a7e9-1b68476b8054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347a04ca096d4dd7aa8bd7f34430e841'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.706033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1378/2769] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:18 2022] DELETE /identity/v3/users/347a04ca096d4dd7aa8bd7f34430e841 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:18.876824 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:18.888696 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808b110-197e-45ca-ba92-d665c9fc138f service placement] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:18.944806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:18.945611 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.945900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.946181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] PATH_INFO: `/v3/projects/84702461af02466ca46283288ff784de` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.947393 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84702461af02466ca46283288ff784de)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:18.949309 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:18.994135 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84702461af02466ca46283288ff784de', 'request_id': 'req-71de645f-1d87-449b-940e-a414c38fbc03'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:19.000202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84702461af02466ca46283288ff784de', 'request_id': 'req-71de645f-1d87-449b-940e-a414c38fbc03'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:19.006175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84702461af02466ca46283288ff784de', 'request_id': 'req-71de645f-1d87-449b-940e-a414c38fbc03'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:19.018054 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] The token cache is being invalidate because project 84702461af02466ca46283288ff784de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:19.018348 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:19.019077 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-71de645f-1d87-449b-940e-a414c38fbc03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:19.021771 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1392/2770] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:18 2022] DELETE /identity/v3/projects/84702461af02466ca46283288ff784de => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:19.026695 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598a8f-0493-476f-a20f-62dd94955cd3 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.027024 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598a8f-0493-476f-a20f-62dd94955cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.027312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598a8f-0493-476f-a20f-62dd94955cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.060131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:19.086426 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b1598a8f-0493-476f-a20f-62dd94955cd3 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:19.087677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b1598a8f-0493-476f-a20f-62dd94955cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:19.147965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1379/2771] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:19.156245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646a85a-17b8-4b87-b40f-fec21b5af536 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.156547 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646a85a-17b8-4b87-b40f-fec21b5af536 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.156831 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646a85a-17b8-4b87-b40f-fec21b5af536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.176036 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-9646a85a-17b8-4b87-b40f-fec21b5af536 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:19.177522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9646a85a-17b8-4b87-b40f-fec21b5af536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:19.185435 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1393/2772] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:19.189531 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1598a8f-0493-476f-a20f-62dd94955cd3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.199294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1598a8f-0493-476f-a20f-62dd94955cd3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.203768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.204420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.204706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.204984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.205706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:19.206015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.207634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.219504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1380/2773] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:19.223620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646a85a-17b8-4b87-b40f-fec21b5af536 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.233257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646a85a-17b8-4b87-b40f-fec21b5af536 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.237793 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94011-e399-465e-a16a-e35d129024ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.238438 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94011-e399-465e-a16a-e35d129024ee admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.238725 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94011-e399-465e-a16a-e35d129024ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.239035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94011-e399-465e-a16a-e35d129024ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.239744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94011-e399-465e-a16a-e35d129024ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.241636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94011-e399-465e-a16a-e35d129024ee admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.268631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1394/2774] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:19.270077 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.280740 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ff83c-0ed5-4b9d-9966-93f028e05915 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.335981 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439ba71-2437-438f-88a9-7afb46384dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.336683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439ba71-2437-438f-88a9-7afb46384dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.336970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439ba71-2437-438f-88a9-7afb46384dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.337247 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439ba71-2437-438f-88a9-7afb46384dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.337936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439ba71-2437-438f-88a9-7afb46384dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.339934 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439ba71-2437-438f-88a9-7afb46384dfe admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.362091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1381/2775] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:19.366256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94011-e399-465e-a16a-e35d129024ee admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.376445 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94011-e399-465e-a16a-e35d129024ee admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.381018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d354b2-170a-46c5-af4b-9d50d4793496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.381682 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d354b2-170a-46c5-af4b-9d50d4793496 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.381967 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d354b2-170a-46c5-af4b-9d50d4793496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.382251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d354b2-170a-46c5-af4b-9d50d4793496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.383017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d354b2-170a-46c5-af4b-9d50d4793496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.385893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d354b2-170a-46c5-af4b-9d50d4793496 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.396845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1395/2776] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:19.400850 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439ba71-2437-438f-88a9-7afb46384dfe admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.411622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439ba71-2437-438f-88a9-7afb46384dfe admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.416254 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814d0d8-b078-4356-9e3b-b5bf01ddcbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.416928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d0d8-b078-4356-9e3b-b5bf01ddcbdb admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.417222 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d0d8-b078-4356-9e3b-b5bf01ddcbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.417511 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d0d8-b078-4356-9e3b-b5bf01ddcbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.418255 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d0d8-b078-4356-9e3b-b5bf01ddcbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.419906 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d0d8-b078-4356-9e3b-b5bf01ddcbdb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.434029 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1382/2777] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:19.435310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d354b2-170a-46c5-af4b-9d50d4793496 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.445319 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d354b2-170a-46c5-af4b-9d50d4793496 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.451626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d047ca1-5946-4bff-a750-3589475be1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.452556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d047ca1-5946-4bff-a750-3589475be1db admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.452906 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d047ca1-5946-4bff-a750-3589475be1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.453250 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d047ca1-5946-4bff-a750-3589475be1db admin admin] PATH_INFO: `/v3/projects/89fe8712bc5c4b76a6c90a5af8923164/users/f626f09818d64e10957e982bdd414062/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.469608 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d047ca1-5946-4bff-a750-3589475be1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fe8712bc5c4b76a6c90a5af8923164, user_id=f626f09818d64e10957e982bdd414062, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.472293 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d047ca1-5946-4bff-a750-3589475be1db admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.485059 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1396/2778] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:19 2022] PUT /identity/v3/projects/89fe8712bc5c4b76a6c90a5af8923164/users/f626f09818d64e10957e982bdd414062/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:19.495805 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad6c6c-e99c-47ef-a386-aeb71d0856a8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.496290 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad6c6c-e99c-47ef-a386-aeb71d0856a8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.496404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad6c6c-e99c-47ef-a386-aeb71d0856a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.522424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cdad6c6c-e99c-47ef-a386-aeb71d0856a8 None None] MFA Rules not processed for user `f626f09818d64e10957e982bdd414062`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:19.523680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cdad6c6c-e99c-47ef-a386-aeb71d0856a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:19.569506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:19.588636 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1383/2779] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:19.594478 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d047ca1-5946-4bff-a750-3589475be1db admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.623131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:19.656573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d047ca1-5946-4bff-a750-3589475be1db admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.661128 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a90e1-f2e0-4127-acb9-58775332364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.661788 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a90e1-f2e0-4127-acb9-58775332364f admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.662079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a90e1-f2e0-4127-acb9-58775332364f admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.662360 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a90e1-f2e0-4127-acb9-58775332364f admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.663103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a90e1-f2e0-4127-acb9-58775332364f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.665019 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a90e1-f2e0-4127-acb9-58775332364f admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.689527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1397/2780] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:19.693609 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad6c6c-e99c-47ef-a386-aeb71d0856a8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.704988 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad6c6c-e99c-47ef-a386-aeb71d0856a8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.760938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b176a0-a7e2-4ac6-b4f6-9f63a3830dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.761621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b176a0-a7e2-4ac6-b4f6-9f63a3830dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.761915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b176a0-a7e2-4ac6-b4f6-9f63a3830dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.762202 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b176a0-a7e2-4ac6-b4f6-9f63a3830dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.763578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b176a0-a7e2-4ac6-b4f6-9f63a3830dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.765504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b176a0-a7e2-4ac6-b4f6-9f63a3830dd5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.784503 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1384/2781] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:19.788541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a90e1-f2e0-4127-acb9-58775332364f admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.798723 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a90e1-f2e0-4127-acb9-58775332364f admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.803548 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a297a8d-0978-4d66-883e-ef13de101038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.804232 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a297a8d-0978-4d66-883e-ef13de101038 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.804518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a297a8d-0978-4d66-883e-ef13de101038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.804792 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a297a8d-0978-4d66-883e-ef13de101038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.805528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a297a8d-0978-4d66-883e-ef13de101038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.807136 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a297a8d-0978-4d66-883e-ef13de101038 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.817948 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1398/2782] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:19.821744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b176a0-a7e2-4ac6-b4f6-9f63a3830dd5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.831964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b176a0-a7e2-4ac6-b4f6-9f63a3830dd5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.836504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cf175-85f9-4698-8fc7-9547a965a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.837369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cf175-85f9-4698-8fc7-9547a965a442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.837654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cf175-85f9-4698-8fc7-9547a965a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.837933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cf175-85f9-4698-8fc7-9547a965a442 admin admin] PATH_INFO: `/v3/projects/35fa26d937084b97bd662d6c259d3c44/users/f8973abd7bdf47deb7fce7eaeacde6d5/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.852212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cf175-85f9-4698-8fc7-9547a965a442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fa26d937084b97bd662d6c259d3c44, user_id=f8973abd7bdf47deb7fce7eaeacde6d5, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.854864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cf175-85f9-4698-8fc7-9547a965a442 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.867097 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1385/2783] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:19 2022] PUT /identity/v3/projects/35fa26d937084b97bd662d6c259d3c44/users/f8973abd7bdf47deb7fce7eaeacde6d5/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:19.870866 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a297a8d-0978-4d66-883e-ef13de101038 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.881591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a297a8d-0978-4d66-883e-ef13de101038 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.936751 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd5e1-cc49-4065-b64e-1ca6f113f15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.937421 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd5e1-cc49-4065-b64e-1ca6f113f15b admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.937709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd5e1-cc49-4065-b64e-1ca6f113f15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.937984 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd5e1-cc49-4065-b64e-1ca6f113f15b admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.938695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd5e1-cc49-4065-b64e-1ca6f113f15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.940327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd5e1-cc49-4065-b64e-1ca6f113f15b admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.949669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1399/2784] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:19.954238 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cf175-85f9-4698-8fc7-9547a965a442 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.965052 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cf175-85f9-4698-8fc7-9547a965a442 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.969874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.970789 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.971091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.971405 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] PATH_INFO: `/v3/projects/35fa26d937084b97bd662d6c259d3c44/users/f8973abd7bdf47deb7fce7eaeacde6d5/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.973402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fa26d937084b97bd662d6c259d3c44, user_id=f8973abd7bdf47deb7fce7eaeacde6d5, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.976149 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.986583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1386/2785] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:19 2022] PUT /identity/v3/projects/35fa26d937084b97bd662d6c259d3c44/users/f8973abd7bdf47deb7fce7eaeacde6d5/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:19.997227 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f008ea-3f4c-4e18-b516-bf3e53a4f077 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.997527 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f008ea-3f4c-4e18-b516-bf3e53a4f077 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.997811 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f008ea-3f4c-4e18-b516-bf3e53a4f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:20.023856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-89f008ea-3f4c-4e18-b516-bf3e53a4f077 None None] MFA Rules not processed for user `f8973abd7bdf47deb7fce7eaeacde6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:20.025069 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-89f008ea-3f4c-4e18-b516-bf3e53a4f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:20.093035 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1400/2786] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:20.103502 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:20.105231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:20.184903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff6acc-6c3d-4777-9eee-b23e9c10390a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:20.188576 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8fe17-a1c9-4a72-b11f-948334684b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:20.189221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8fe17-a1c9-4a72-b11f-948334684b36 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:20.189508 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8fe17-a1c9-4a72-b11f-948334684b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:20.189785 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8fe17-a1c9-4a72-b11f-948334684b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:20.221621 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:20.245012 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8fe17-a1c9-4a72-b11f-948334684b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:20.246453 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8fe17-a1c9-4a72-b11f-948334684b36 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:20.255935 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1387/2787] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:22.783550 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f008ea-3f4c-4e18-b516-bf3e53a4f077 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:22.794291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f008ea-3f4c-4e18-b516-bf3e53a4f077 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:22.798602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f20259-6b11-44b9-833d-790b5d90ab7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:22.799286 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f20259-6b11-44b9-833d-790b5d90ab7d service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:22.799575 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f20259-6b11-44b9-833d-790b5d90ab7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:22.800662 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f20259-6b11-44b9-833d-790b5d90ab7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:22.811270 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f20259-6b11-44b9-833d-790b5d90ab7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:22.812704 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f20259-6b11-44b9-833d-790b5d90ab7d service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:22.822088 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1401/2788] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:30.251883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=11 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:32.817843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:35.181487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8fe17-a1c9-4a72-b11f-948334684b36 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:35.241733 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8fe17-a1c9-4a72-b11f-948334684b36 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:35.246155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:35.247048 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.247374 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.248169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] PATH_INFO: `/v3/users/f626f09818d64e10957e982bdd414062` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.249338 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f626f09818d64e10957e982bdd414062)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:35.251268 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:35.294011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f626f09818d64e10957e982bdd414062'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.295197 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f626f09818d64e10957e982bdd414062'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.302387 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f626f09818d64e10957e982bdd414062'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.309407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f626f09818d64e10957e982bdd414062'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.321549 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f626f09818d64e10957e982bdd414062'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.327253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1388/2789] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:35 2022] DELETE /identity/v3/users/f626f09818d64e10957e982bdd414062 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:35.331857 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5f56d-253e-4fbe-bfbe-f0e1d4e37816 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.332329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5f56d-253e-4fbe-bfbe-f0e1d4e37816 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.332450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5f56d-253e-4fbe-bfbe-f0e1d4e37816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.350537 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f0b5f56d-253e-4fbe-bfbe-f0e1d4e37816 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:35.351774 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f0b5f56d-253e-4fbe-bfbe-f0e1d4e37816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:35.408710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1402/2790] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:35.418243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:35.420152 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:35.495992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e708b-efd9-4326-8b14-4ca0a610f93e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:35.500196 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c639-ed6e-4678-8570-47c4e76e6885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:35.500842 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c639-ed6e-4678-8570-47c4e76e6885 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.501128 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c639-ed6e-4678-8570-47c4e76e6885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.501407 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c639-ed6e-4678-8570-47c4e76e6885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.510165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488c639-ed6e-4678-8570-47c4e76e6885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:35.511610 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488c639-ed6e-4678-8570-47c4e76e6885 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:35.520874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1389/2791] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:35.780972 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5f56d-253e-4fbe-bfbe-f0e1d4e37816 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:35.782480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f0b5f56d-253e-4fbe-bfbe-f0e1d4e37816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:35.798471 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5f56d-253e-4fbe-bfbe-f0e1d4e37816 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:35.803451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:35.804370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.804658 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.804997 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] PATH_INFO: `/v3/projects/89fe8712bc5c4b76a6c90a5af8923164` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.806120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89fe8712bc5c4b76a6c90a5af8923164)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:35.808062 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:35.853560 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89fe8712bc5c4b76a6c90a5af8923164', 'request_id': 'req-08ea764b-3333-40a4-b3ee-82afe2fad792'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.859591 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89fe8712bc5c4b76a6c90a5af8923164', 'request_id': 'req-08ea764b-3333-40a4-b3ee-82afe2fad792'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.865595 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89fe8712bc5c4b76a6c90a5af8923164', 'request_id': 'req-08ea764b-3333-40a4-b3ee-82afe2fad792'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.877415 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] The token cache is being invalidate because project 89fe8712bc5c4b76a6c90a5af8923164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:35.877709 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.878334 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.879889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1403/2792] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:35 2022] DELETE /identity/v3/projects/89fe8712bc5c4b76a6c90a5af8923164 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:35.884122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c639-ed6e-4678-8570-47c4e76e6885 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:35.889501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:35.895947 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c639-ed6e-4678-8570-47c4e76e6885 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:35.952631 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:35.953504 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.953795 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.954085 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] PATH_INFO: `/v3/users/f8973abd7bdf47deb7fce7eaeacde6d5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.955289 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8973abd7bdf47deb7fce7eaeacde6d5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:35.957401 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.004672 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8973abd7bdf47deb7fce7eaeacde6d5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.005307 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8973abd7bdf47deb7fce7eaeacde6d5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.011704 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8973abd7bdf47deb7fce7eaeacde6d5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.019033 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8973abd7bdf47deb7fce7eaeacde6d5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.031200 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-47064113-6fa7-4e9c-83d2-0d9a7e71de1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8973abd7bdf47deb7fce7eaeacde6d5'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.036999 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1390/2793] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:35 2022] DELETE /identity/v3/users/f8973abd7bdf47deb7fce7eaeacde6d5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:36.299294 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.300717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.318715 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea764b-3333-40a4-b3ee-82afe2fad792 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.372836 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.373695 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.373981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.374257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] PATH_INFO: `/v3/projects/35fa26d937084b97bd662d6c259d3c44` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.375417 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fa26d937084b97bd662d6c259d3c44)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.377331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.406707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:36.423770 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fa26d937084b97bd662d6c259d3c44', 'request_id': 'req-8a80f437-d6f7-42e8-8b01-efc086705b5d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.429351 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fa26d937084b97bd662d6c259d3c44', 'request_id': 'req-8a80f437-d6f7-42e8-8b01-efc086705b5d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.435702 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fa26d937084b97bd662d6c259d3c44', 'request_id': 'req-8a80f437-d6f7-42e8-8b01-efc086705b5d'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.447558 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] The token cache is being invalidate because project 35fa26d937084b97bd662d6c259d3c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:36.447846 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.448460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-8a80f437-d6f7-42e8-8b01-efc086705b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.450076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1404/2794] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:36 2022] DELETE /identity/v3/projects/35fa26d937084b97bd662d6c259d3c44 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:36.455764 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6eb86-42df-46a2-9296-e9a745511fc1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.456233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6eb86-42df-46a2-9296-e9a745511fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.456349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6eb86-42df-46a2-9296-e9a745511fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.474967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4ca6eb86-42df-46a2-9296-e9a745511fc1 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:36.476192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4ca6eb86-42df-46a2-9296-e9a745511fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.537675 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1391/2795] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:36.546735 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f6455-49d7-4ddd-b5eb-0329aabfe5bb None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.547066 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f6455-49d7-4ddd-b5eb-0329aabfe5bb None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.547344 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f6455-49d7-4ddd-b5eb-0329aabfe5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.566130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-023f6455-49d7-4ddd-b5eb-0329aabfe5bb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:36.567387 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-023f6455-49d7-4ddd-b5eb-0329aabfe5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.575079 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1405/2796] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:36.579966 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6eb86-42df-46a2-9296-e9a745511fc1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.589432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6eb86-42df-46a2-9296-e9a745511fc1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.593929 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.594583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.594911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.595194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.595948 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:36.596259 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.597846 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.609169 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1392/2797] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:42:36.613302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f6455-49d7-4ddd-b5eb-0329aabfe5bb None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.623092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f6455-49d7-4ddd-b5eb-0329aabfe5bb None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.627802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc6468-d54b-444e-99a7-f42207103d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.628451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc6468-d54b-444e-99a7-f42207103d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.628739 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc6468-d54b-444e-99a7-f42207103d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.629018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc6468-d54b-444e-99a7-f42207103d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.629710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc6468-d54b-444e-99a7-f42207103d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.631633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc6468-d54b-444e-99a7-f42207103d9c admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.656536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1406/2798] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:36 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:36.660622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.671021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad3125-f3fa-494b-8cf7-d9bd8166efbd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.675618 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:36.727833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84446-9ba9-4a18-93ea-808cc43cca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.728506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84446-9ba9-4a18-93ea-808cc43cca76 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.728797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84446-9ba9-4a18-93ea-808cc43cca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.729080 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84446-9ba9-4a18-93ea-808cc43cca76 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.729768 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df84446-9ba9-4a18-93ea-808cc43cca76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.732201 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df84446-9ba9-4a18-93ea-808cc43cca76 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.750763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1393/2799] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:36 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:36.754799 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc6468-d54b-444e-99a7-f42207103d9c admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.764905 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc6468-d54b-444e-99a7-f42207103d9c admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.769484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71915086-6535-49ad-b0f3-5326b4e9cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.770139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71915086-6535-49ad-b0f3-5326b4e9cecd admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.770429 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71915086-6535-49ad-b0f3-5326b4e9cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.770710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71915086-6535-49ad-b0f3-5326b4e9cecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.771474 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71915086-6535-49ad-b0f3-5326b4e9cecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.773072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71915086-6535-49ad-b0f3-5326b4e9cecd admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.783808 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1407/2800] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:36.787600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84446-9ba9-4a18-93ea-808cc43cca76 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.798340 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84446-9ba9-4a18-93ea-808cc43cca76 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.803501 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212b109-dc37-4105-963c-c59d9ecf5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.804402 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212b109-dc37-4105-963c-c59d9ecf5732 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.804687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212b109-dc37-4105-963c-c59d9ecf5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.804995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212b109-dc37-4105-963c-c59d9ecf5732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.805726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212b109-dc37-4105-963c-c59d9ecf5732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.807420 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212b109-dc37-4105-963c-c59d9ecf5732 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.818537 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1394/2801] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:36.822717 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71915086-6535-49ad-b0f3-5326b4e9cecd admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.832827 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71915086-6535-49ad-b0f3-5326b4e9cecd admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.837484 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae6c78-e11b-4d97-850e-cdde08e9e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.838366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6c78-e11b-4d97-850e-cdde08e9e1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.838655 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6c78-e11b-4d97-850e-cdde08e9e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.838963 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6c78-e11b-4d97-850e-cdde08e9e1a7 admin admin] PATH_INFO: `/v3/projects/f336efb2424d44e0ae287da6f3ac271c/users/aa6bbe5ebae340679f9d0b274bd94d46/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.853324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae6c78-e11b-4d97-850e-cdde08e9e1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f336efb2424d44e0ae287da6f3ac271c, user_id=aa6bbe5ebae340679f9d0b274bd94d46, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.856012 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae6c78-e11b-4d97-850e-cdde08e9e1a7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.868971 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1408/2802] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:36 2022] PUT /identity/v3/projects/f336efb2424d44e0ae287da6f3ac271c/users/aa6bbe5ebae340679f9d0b274bd94d46/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:36.879662 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ff01-e039-4c2f-b2ab-631343851309 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.879987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ff01-e039-4c2f-b2ab-631343851309 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.880294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ff01-e039-4c2f-b2ab-631343851309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.906644 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-def2ff01-e039-4c2f-b2ab-631343851309 None None] MFA Rules not processed for user `aa6bbe5ebae340679f9d0b274bd94d46`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:36.907927 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-def2ff01-e039-4c2f-b2ab-631343851309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.972313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1395/2803] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:36.976843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae6c78-e11b-4d97-850e-cdde08e9e1a7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.037206 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae6c78-e11b-4d97-850e-cdde08e9e1a7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.041806 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79fdc4-58dd-4377-8517-4f7407ab161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.042464 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79fdc4-58dd-4377-8517-4f7407ab161d admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.042753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79fdc4-58dd-4377-8517-4f7407ab161d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.043070 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79fdc4-58dd-4377-8517-4f7407ab161d admin admin] PATH_INFO: `/v3/projects` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.043753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79fdc4-58dd-4377-8517-4f7407ab161d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.046215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79fdc4-58dd-4377-8517-4f7407ab161d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.071557 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1409/2804] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:36 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:37.075825 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ff01-e039-4c2f-b2ab-631343851309 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.086581 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ff01-e039-4c2f-b2ab-631343851309 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.142562 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faf851-96f9-41cd-a852-ab3a88742d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.143271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faf851-96f9-41cd-a852-ab3a88742d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.143683 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faf851-96f9-41cd-a852-ab3a88742d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.143975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faf851-96f9-41cd-a852-ab3a88742d1f admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.144677 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faf851-96f9-41cd-a852-ab3a88742d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.146599 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faf851-96f9-41cd-a852-ab3a88742d1f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.168095 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1396/2805] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:37 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:37.172584 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79fdc4-58dd-4377-8517-4f7407ab161d admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.183162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79fdc4-58dd-4377-8517-4f7407ab161d admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.187978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70a5be-8788-4850-ab10-517ba962ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.188638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70a5be-8788-4850-ab10-517ba962ac07 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.188929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70a5be-8788-4850-ab10-517ba962ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.189215 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70a5be-8788-4850-ab10-517ba962ac07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.189943 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70a5be-8788-4850-ab10-517ba962ac07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.191596 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70a5be-8788-4850-ab10-517ba962ac07 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.201992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1410/2806] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:37.205905 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faf851-96f9-41cd-a852-ab3a88742d1f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.215773 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faf851-96f9-41cd-a852-ab3a88742d1f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.220899 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88717-c444-4ca1-9e66-5c38c621c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.221774 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88717-c444-4ca1-9e66-5c38c621c8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.222060 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88717-c444-4ca1-9e66-5c38c621c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.222393 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88717-c444-4ca1-9e66-5c38c621c8c3 admin admin] PATH_INFO: `/v3/projects/9c589669c3c64cc4ac78266264d81092/users/85f314a54b454a42adeab507ba95c894/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.224556 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:37.239372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88717-c444-4ca1-9e66-5c38c621c8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c589669c3c64cc4ac78266264d81092, user_id=85f314a54b454a42adeab507ba95c894, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.242158 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88717-c444-4ca1-9e66-5c38c621c8c3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.254724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1397/2807] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:37 2022] PUT /identity/v3/projects/9c589669c3c64cc4ac78266264d81092/users/85f314a54b454a42adeab507ba95c894/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:37.258602 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70a5be-8788-4850-ab10-517ba962ac07 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.268469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70a5be-8788-4850-ab10-517ba962ac07 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.288306 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:37.326000 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff6289-70a6-45f5-9c91-91e80781813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.326673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6289-70a6-45f5-9c91-91e80781813d admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.326992 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6289-70a6-45f5-9c91-91e80781813d admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.327277 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff6289-70a6-45f5-9c91-91e80781813d admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.327999 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff6289-70a6-45f5-9c91-91e80781813d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.329706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff6289-70a6-45f5-9c91-91e80781813d admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.339349 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1411/2808] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:37.343983 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88717-c444-4ca1-9e66-5c38c621c8c3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.354360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88717-c444-4ca1-9e66-5c38c621c8c3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.359679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.360565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.360858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.361146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] PATH_INFO: `/v3/projects/9c589669c3c64cc4ac78266264d81092/users/85f314a54b454a42adeab507ba95c894/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.363156 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c589669c3c64cc4ac78266264d81092, user_id=85f314a54b454a42adeab507ba95c894, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.365822 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.376055 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1398/2809] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:37 2022] PUT /identity/v3/projects/9c589669c3c64cc4ac78266264d81092/users/85f314a54b454a42adeab507ba95c894/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:37.386008 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a2a7-e997-48cb-840c-3197450b969a None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.386462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a2a7-e997-48cb-840c-3197450b969a None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.386585 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a2a7-e997-48cb-840c-3197450b969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.413638 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-6dd4a2a7-e997-48cb-840c-3197450b969a None None] MFA Rules not processed for user `85f314a54b454a42adeab507ba95c894`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:37.414889 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6dd4a2a7-e997-48cb-840c-3197450b969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.481320 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1412/2810] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:37.492474 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.494199 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.551809 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f0784-0e9b-4613-8771-45c7887d5110 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.555656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed1aa8-5e73-44d5-9c9c-01fa364a2519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.556410 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1aa8-5e73-44d5-9c9c-01fa364a2519 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.556699 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1aa8-5e73-44d5-9c9c-01fa364a2519 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.556977 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1aa8-5e73-44d5-9c9c-01fa364a2519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.565717 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed1aa8-5e73-44d5-9c9c-01fa364a2519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.567203 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed1aa8-5e73-44d5-9c9c-01fa364a2519 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.577227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1399/2811] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:37.640067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4a2a7-e997-48cb-840c-3197450b969a None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.701106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4a2a7-e997-48cb-840c-3197450b969a None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.705644 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.706528 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.706919 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.707207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] PATH_INFO: `/v3/users/aa6bbe5ebae340679f9d0b274bd94d46` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.708412 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6bbe5ebae340679f9d0b274bd94d46)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.710333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.755092 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6bbe5ebae340679f9d0b274bd94d46'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.756137 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:37.769100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6bbe5ebae340679f9d0b274bd94d46'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.769769 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6bbe5ebae340679f9d0b274bd94d46'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.778065 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6bbe5ebae340679f9d0b274bd94d46'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.785422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6bbe5ebae340679f9d0b274bd94d46'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.791330 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1413/2812] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:37 2022] DELETE /identity/v3/users/aa6bbe5ebae340679f9d0b274bd94d46 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:37.795890 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c37b8-843d-4b89-b0c1-82fcde466912 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.796185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c37b8-843d-4b89-b0c1-82fcde466912 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.796489 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c37b8-843d-4b89-b0c1-82fcde466912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.814529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bb9c37b8-843d-4b89-b0c1-82fcde466912 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:37.815810 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bb9c37b8-843d-4b89-b0c1-82fcde466912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.874867 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1400/2813] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:37.884670 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.886068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.941862 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6158fdf-b359-47ac-98d3-5dd1abbb47e1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.945428 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7f7e-cef2-42aa-a7a1-1e3fc710b76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.946068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7f7e-cef2-42aa-a7a1-1e3fc710b76d service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.946352 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7f7e-cef2-42aa-a7a1-1e3fc710b76d service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.946626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7f7e-cef2-42aa-a7a1-1e3fc710b76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.955453 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd7f7e-cef2-42aa-a7a1-1e3fc710b76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.956981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd7f7e-cef2-42aa-a7a1-1e3fc710b76d service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.968665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1414/2814] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:38.235274 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c37b8-843d-4b89-b0c1-82fcde466912 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.236689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bb9c37b8-843d-4b89-b0c1-82fcde466912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:38.248747 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c37b8-843d-4b89-b0c1-82fcde466912 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.253604 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.254485 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.254796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.255082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] PATH_INFO: `/v3/projects/f336efb2424d44e0ae287da6f3ac271c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.256287 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f336efb2424d44e0ae287da6f3ac271c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.258322 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.305506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f336efb2424d44e0ae287da6f3ac271c', 'request_id': 'req-460945ed-325f-4b9e-85bd-be1d1771ea29'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.311666 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f336efb2424d44e0ae287da6f3ac271c', 'request_id': 'req-460945ed-325f-4b9e-85bd-be1d1771ea29'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.317091 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f336efb2424d44e0ae287da6f3ac271c', 'request_id': 'req-460945ed-325f-4b9e-85bd-be1d1771ea29'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.320550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:38.331569 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] The token cache is being invalidate because project f336efb2424d44e0ae287da6f3ac271c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:38.331859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.332480 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.334031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1401/2815] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:38 2022] DELETE /identity/v3/projects/f336efb2424d44e0ae287da6f3ac271c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:38.337988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7f7e-cef2-42aa-a7a1-1e3fc710b76d service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.348315 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7f7e-cef2-42aa-a7a1-1e3fc710b76d service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.403323 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.404753 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.405041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.405327 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] PATH_INFO: `/v3/users/85f314a54b454a42adeab507ba95c894` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.406506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f314a54b454a42adeab507ba95c894)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.408467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.455511 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f314a54b454a42adeab507ba95c894'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.469432 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f314a54b454a42adeab507ba95c894'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.470098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f314a54b454a42adeab507ba95c894'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.473635 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:38.485181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f314a54b454a42adeab507ba95c894'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.496460 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-bc36bb58-d49b-469a-aa67-4f6719641242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f314a54b454a42adeab507ba95c894'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.502887 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1415/2816] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:38 2022] DELETE /identity/v3/users/85f314a54b454a42adeab507ba95c894 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:38.772802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.774328 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:38.788179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460945ed-325f-4b9e-85bd-be1d1771ea29 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.847496 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.848293 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.848578 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.848857 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] PATH_INFO: `/v3/projects/9c589669c3c64cc4ac78266264d81092` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.850053 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c589669c3c64cc4ac78266264d81092)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.851984 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.897944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c589669c3c64cc4ac78266264d81092', 'request_id': 'req-5594e1fc-be5d-4f65-9a8b-6412be96c463'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.904122 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c589669c3c64cc4ac78266264d81092', 'request_id': 'req-5594e1fc-be5d-4f65-9a8b-6412be96c463'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.909651 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c589669c3c64cc4ac78266264d81092', 'request_id': 'req-5594e1fc-be5d-4f65-9a8b-6412be96c463'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.921937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] The token cache is being invalidate because project 9c589669c3c64cc4ac78266264d81092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:38.922224 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.922928 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5594e1fc-be5d-4f65-9a8b-6412be96c463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.924444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1402/2817] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:38 2022] DELETE /identity/v3/projects/9c589669c3c64cc4ac78266264d81092 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:38.930656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60d50d-2a0b-4d37-99fd-c4c460908d8f None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.931003 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60d50d-2a0b-4d37-99fd-c4c460908d8f None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.931289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60d50d-2a0b-4d37-99fd-c4c460908d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.949529 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-fb60d50d-2a0b-4d37-99fd-c4c460908d8f None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:38.950734 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-fb60d50d-2a0b-4d37-99fd-c4c460908d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.008697 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1416/2818] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:39.017601 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea605-ce41-4f01-a1f8-34d4345cb937 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.017895 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea605-ce41-4f01-a1f8-34d4345cb937 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.018178 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea605-ce41-4f01-a1f8-34d4345cb937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.035856 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b0dea605-ce41-4f01-a1f8-34d4345cb937 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:39.037046 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b0dea605-ce41-4f01-a1f8-34d4345cb937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.045295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1403/2819] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:39.049357 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60d50d-2a0b-4d37-99fd-c4c460908d8f None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.059302 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60d50d-2a0b-4d37-99fd-c4c460908d8f None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.064692 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.064962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.065246 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.065521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.066248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:39.066556 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.068181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.079633 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1417/2820] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:39.083903 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea605-ce41-4f01-a1f8-34d4345cb937 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.093022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea605-ce41-4f01-a1f8-34d4345cb937 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.097577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d408a-488e-44c5-baef-7bcafc40593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.098179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d408a-488e-44c5-baef-7bcafc40593c admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.098467 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d408a-488e-44c5-baef-7bcafc40593c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.098743 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d408a-488e-44c5-baef-7bcafc40593c admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.099451 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d408a-488e-44c5-baef-7bcafc40593c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.101327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d408a-488e-44c5-baef-7bcafc40593c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.127756 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1404/2821] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:39.132067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.142145 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ab4de-6ba1-411f-8a0e-256b34b106b8 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.200225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74393e7d-811d-4dbb-8845-697f4f5b18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.200904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74393e7d-811d-4dbb-8845-697f4f5b18cb admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.201195 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74393e7d-811d-4dbb-8845-697f4f5b18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.201477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74393e7d-811d-4dbb-8845-697f4f5b18cb admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.202160 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74393e7d-811d-4dbb-8845-697f4f5b18cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.204115 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74393e7d-811d-4dbb-8845-697f4f5b18cb admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.222023 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1418/2822] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:39.226047 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d408a-488e-44c5-baef-7bcafc40593c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.236696 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d408a-488e-44c5-baef-7bcafc40593c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.241513 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a612aee-f286-4c0d-816a-16641654a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.242186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612aee-f286-4c0d-816a-16641654a832 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.242487 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612aee-f286-4c0d-816a-16641654a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.242787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612aee-f286-4c0d-816a-16641654a832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.243547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a612aee-f286-4c0d-816a-16641654a832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.245165 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a612aee-f286-4c0d-816a-16641654a832 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.256049 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1405/2823] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:39.259796 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74393e7d-811d-4dbb-8845-697f4f5b18cb admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.269396 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74393e7d-811d-4dbb-8845-697f4f5b18cb admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.273871 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195f1d6-143c-409b-84b5-ab26d8f6de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.274517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195f1d6-143c-409b-84b5-ab26d8f6de99 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.274894 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195f1d6-143c-409b-84b5-ab26d8f6de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.275184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195f1d6-143c-409b-84b5-ab26d8f6de99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.275902 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195f1d6-143c-409b-84b5-ab26d8f6de99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.277491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195f1d6-143c-409b-84b5-ab26d8f6de99 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.287630 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1419/2824] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:39.291473 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a612aee-f286-4c0d-816a-16641654a832 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.301995 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a612aee-f286-4c0d-816a-16641654a832 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.306915 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.307787 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.308070 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.308345 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] PATH_INFO: `/v3/projects/98803f61600b4ef5973dcb8bc6075fd1/users/fa5e38e0483c49128e282efd720dbc6f/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.323528 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98803f61600b4ef5973dcb8bc6075fd1, user_id=fa5e38e0483c49128e282efd720dbc6f, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.326179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.339114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1406/2825] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:39 2022] PUT /identity/v3/projects/98803f61600b4ef5973dcb8bc6075fd1/users/fa5e38e0483c49128e282efd720dbc6f/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:39.349654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685f16-b925-46ca-ad2b-2289ba669048 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.349898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685f16-b925-46ca-ad2b-2289ba669048 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.350179 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685f16-b925-46ca-ad2b-2289ba669048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.375982 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-53685f16-b925-46ca-ad2b-2289ba669048 None None] MFA Rules not processed for user `fa5e38e0483c49128e282efd720dbc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:39.377178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-53685f16-b925-46ca-ad2b-2289ba669048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.417053 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:39.440955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1420/2826] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:39.452379 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.454035 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.479700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:39.512140 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4185b-aabc-4fc8-b46e-d11a2f9bc673 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.515859 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6f726-d11e-45ac-8b93-872404a77f8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a81dce4c3ffd42bd85bf6e7687b5cbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.516509 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f726-d11e-45ac-8b93-872404a77f8f service glance] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.516796 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f726-d11e-45ac-8b93-872404a77f8f service glance] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.517076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f726-d11e-45ac-8b93-872404a77f8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.525333 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6f726-d11e-45ac-8b93-872404a77f8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.526758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6f726-d11e-45ac-8b93-872404a77f8f service glance] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.536005 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1407/2827] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:49.438078 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=8 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:49.532026 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=16 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:54.931587 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53685f16-b925-46ca-ad2b-2289ba669048 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:54.993303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53685f16-b925-46ca-ad2b-2289ba669048 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:54.997754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:54.999422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:54.999710 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:54.999998 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] PATH_INFO: `/v3/users/fa5e38e0483c49128e282efd720dbc6f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.001184 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5e38e0483c49128e282efd720dbc6f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.003147 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.047281 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5e38e0483c49128e282efd720dbc6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.059289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5e38e0483c49128e282efd720dbc6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.059974 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5e38e0483c49128e282efd720dbc6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.067414 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5e38e0483c49128e282efd720dbc6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.074196 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5e38e0483c49128e282efd720dbc6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.080091 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1421/2828] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:54 2022] DELETE /identity/v3/users/fa5e38e0483c49128e282efd720dbc6f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:55.084529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858102-3d09-4511-8f3b-8a9e202ceb3e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.084987 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858102-3d09-4511-8f3b-8a9e202ceb3e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.085112 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858102-3d09-4511-8f3b-8a9e202ceb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.102757 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a1858102-3d09-4511-8f3b-8a9e202ceb3e None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:55.104187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a1858102-3d09-4511-8f3b-8a9e202ceb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:55.161802 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1408/2829] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:55.171301 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.172736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:55.228687 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b42fb-9fff-42c1-97e0-e74ce25ef823 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.232257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3eb0b-06e0-488c-89ad-612dfa11b4aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.232904 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3eb0b-06e0-488c-89ad-612dfa11b4aa service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.233187 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3eb0b-06e0-488c-89ad-612dfa11b4aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.233462 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3eb0b-06e0-488c-89ad-612dfa11b4aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.242331 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3eb0b-06e0-488c-89ad-612dfa11b4aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.243790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3eb0b-06e0-488c-89ad-612dfa11b4aa service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.253543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1422/2830] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:55.510114 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858102-3d09-4511-8f3b-8a9e202ceb3e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.511943 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a1858102-3d09-4511-8f3b-8a9e202ceb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:55.527041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858102-3d09-4511-8f3b-8a9e202ceb3e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.536212 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.537087 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.537454 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.537640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] PATH_INFO: `/v3/projects/98803f61600b4ef5973dcb8bc6075fd1` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.539028 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98803f61600b4ef5973dcb8bc6075fd1)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.540974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.590066 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98803f61600b4ef5973dcb8bc6075fd1', 'request_id': 'req-d26de0e7-6e97-49a3-83b5-e07b71af14d0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.596299 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98803f61600b4ef5973dcb8bc6075fd1', 'request_id': 'req-d26de0e7-6e97-49a3-83b5-e07b71af14d0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.602013 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98803f61600b4ef5973dcb8bc6075fd1', 'request_id': 'req-d26de0e7-6e97-49a3-83b5-e07b71af14d0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.614278 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] The token cache is being invalidate because project 98803f61600b4ef5973dcb8bc6075fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:55.614565 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.615204 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d26de0e7-6e97-49a3-83b5-e07b71af14d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.616760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1409/2831] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:55 2022] DELETE /identity/v3/projects/98803f61600b4ef5973dcb8bc6075fd1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:55.621615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba26d-2e09-4eb1-9d90-ce4db5985cb9 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.621960 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba26d-2e09-4eb1-9d90-ce4db5985cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.622241 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba26d-2e09-4eb1-9d90-ce4db5985cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.640555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-9bdba26d-2e09-4eb1-9d90-ce4db5985cb9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:55.641754 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-9bdba26d-2e09-4eb1-9d90-ce4db5985cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:55.657830 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:55.702172 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1423/2832] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:55.710505 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb104-a14a-45b8-9c22-439a010b71ec None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.710830 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb104-a14a-45b8-9c22-439a010b71ec None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.711243 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb104-a14a-45b8-9c22-439a010b71ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.729054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a93cb104-a14a-45b8-9c22-439a010b71ec None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:55.730244 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a93cb104-a14a-45b8-9c22-439a010b71ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:55.738596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1410/2833] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:55.742545 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdba26d-2e09-4eb1-9d90-ce4db5985cb9 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.752903 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdba26d-2e09-4eb1-9d90-ce4db5985cb9 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.757517 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.758173 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.758463 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.758745 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.759506 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:55.759818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.761422 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.773223 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1424/2834] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:55.777438 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cb104-a14a-45b8-9c22-439a010b71ec None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.787248 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cb104-a14a-45b8-9c22-439a010b71ec None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.791938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405456b5-7b84-4819-afee-21a45104907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.792628 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405456b5-7b84-4819-afee-21a45104907d admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.792922 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405456b5-7b84-4819-afee-21a45104907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.793211 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405456b5-7b84-4819-afee-21a45104907d admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.793909 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405456b5-7b84-4819-afee-21a45104907d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.796477 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405456b5-7b84-4819-afee-21a45104907d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.823794 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1411/2835] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:55.827800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.837785 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f33ab-a5c9-4836-b5de-24d5b4053a40 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.893652 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e6bae-8e9b-4331-ad4f-4cd495e1f888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.894332 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6bae-8e9b-4331-ad4f-4cd495e1f888 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.894624 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6bae-8e9b-4331-ad4f-4cd495e1f888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.894951 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6bae-8e9b-4331-ad4f-4cd495e1f888 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.895679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e6bae-8e9b-4331-ad4f-4cd495e1f888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.897600 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e6bae-8e9b-4331-ad4f-4cd495e1f888 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.918068 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1425/2836] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:55.922893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405456b5-7b84-4819-afee-21a45104907d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.933571 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405456b5-7b84-4819-afee-21a45104907d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.938173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebaec3a-8304-4310-98e7-c6adc6f0628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.938868 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaec3a-8304-4310-98e7-c6adc6f0628e admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.939160 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaec3a-8304-4310-98e7-c6adc6f0628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.939444 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaec3a-8304-4310-98e7-c6adc6f0628e admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.940173 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebaec3a-8304-4310-98e7-c6adc6f0628e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.941771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebaec3a-8304-4310-98e7-c6adc6f0628e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.951923 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1412/2837] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:55.955679 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e6bae-8e9b-4331-ad4f-4cd495e1f888 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.965385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e6bae-8e9b-4331-ad4f-4cd495e1f888 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.971131 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747d198-4ac5-4bed-992b-82004161b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.971800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747d198-4ac5-4bed-992b-82004161b4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.972089 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747d198-4ac5-4bed-992b-82004161b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.972372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747d198-4ac5-4bed-992b-82004161b4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.973100 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747d198-4ac5-4bed-992b-82004161b4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.974731 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747d198-4ac5-4bed-992b-82004161b4c4 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.985257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1426/2838] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:55.989249 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebaec3a-8304-4310-98e7-c6adc6f0628e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.999131 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebaec3a-8304-4310-98e7-c6adc6f0628e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.004048 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.005109 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.005406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.005693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] PATH_INFO: `/v3/projects/8fada75f06eb4ebca951b77d81d7a55b/users/437a7df5b1ee456ba04ac1e73e817582/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.025014 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fada75f06eb4ebca951b77d81d7a55b, user_id=437a7df5b1ee456ba04ac1e73e817582, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.027705 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:56.041542 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1413/2839] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:55 2022] PUT /identity/v3/projects/8fada75f06eb4ebca951b77d81d7a55b/users/437a7df5b1ee456ba04ac1e73e817582/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:56.049780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0020d1d-0e21-4a20-a2aa-572d6cef3525 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.050155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0020d1d-0e21-4a20-a2aa-572d6cef3525 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.050541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0020d1d-0e21-4a20-a2aa-572d6cef3525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.068790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f0020d1d-0e21-4a20-a2aa-572d6cef3525 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:56.069995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f0020d1d-0e21-4a20-a2aa-572d6cef3525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:56.127921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1427/2840] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:56.137389 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.139761 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:56.161649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:56.198188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc067f-2db2-4e24-b7bc-7cd62dd1e3d5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.202506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.203021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.203315 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.203600 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.212712 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.214082 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:56.224272 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1414/2841] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:56.870451 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f80664-054c-402d-aa9a-64f1846dfabb None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.870701 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f80664-054c-402d-aa9a-64f1846dfabb None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.870938 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f80664-054c-402d-aa9a-64f1846dfabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.902901 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f7f80664-054c-402d-aa9a-64f1846dfabb None None] MFA Rules not processed for user `437a7df5b1ee456ba04ac1e73e817582`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:56.904130 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f7f80664-054c-402d-aa9a-64f1846dfabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:56.924087 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:56.973703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1428/2842] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:56.985186 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.986527 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:57.042500 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fac8e-6968-43f9-9d2c-e569ee0a1cf8 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:57.046656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:57.047350 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:57.047640 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:57.047921 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:57.056693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:57.058124 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:57.067693 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1415/2843] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:58.394741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd92ad2-eadb-4518-81d5-364de9a1ba9e None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:58.395256 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd92ad2-eadb-4518-81d5-364de9a1ba9e None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:58.395370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd92ad2-eadb-4518-81d5-364de9a1ba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:58.413032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-dcd92ad2-eadb-4518-81d5-364de9a1ba9e None None] MFA Rules not processed for user `437a7df5b1ee456ba04ac1e73e817582`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:58.414262 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-dcd92ad2-eadb-4518-81d5-364de9a1ba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:58.421026 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1429/2844] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:07.063608 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=43 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:08.408017 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=22 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:22.399038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:22.400481 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:22.411940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71d6ec-e557-4f6a-bb51-dd823c125aba service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:22.415547 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:22.416185 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:22.416472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:22.416753 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:22.418458 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:22.507512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:22.508944 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:22.529054 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1416/2845] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:25.334668 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e0d2-bb0d-4577-8857-5de1c6b45d00 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:25.335272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e0d2-bb0d-4577-8857-5de1c6b45d00 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:25.335272 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e0d2-bb0d-4577-8857-5de1c6b45d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:25.353371 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-56f0e0d2-bb0d-4577-8857-5de1c6b45d00 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:25.354582 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-56f0e0d2-bb0d-4577-8857-5de1c6b45d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:25.362385 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1430/2846] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:25.388938 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:25.390707 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:25.405335 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddd789-3a21-4ed2-b0fb-259a3774fd6f service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:25.411433 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:25.412079 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:25.412372 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:25.412656 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:25.420758 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:25.422327 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:25.432031 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1417/2847] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:28.379673 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd516-558b-4478-8430-1407f371d1a9 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:28.380248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd516-558b-4478-8430-1407f371d1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:28.380248 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd516-558b-4478-8430-1407f371d1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:28.399055 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-14cdd516-558b-4478-8430-1407f371d1a9 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:28.400383 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-14cdd516-558b-4478-8430-1407f371d1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:28.412153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1431/2848] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:28.436007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:28.437365 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:28.452263 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9f0b9-8cee-4d45-87bd-6a698b5b9f62 service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:28.458309 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2faee-3e41-4e6f-be1b-7915c73bbdce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:28.459011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2faee-3e41-4e6f-be1b-7915c73bbdce service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:28.459301 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2faee-3e41-4e6f-be1b-7915c73bbdce service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:28.459582 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2faee-3e41-4e6f-be1b-7915c73bbdce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:28.467933 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2faee-3e41-4e6f-be1b-7915c73bbdce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:28.469510 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2faee-3e41-4e6f-be1b-7915c73bbdce service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:28.479782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1418/2849] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:31.614377 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f3f1-ce3c-47da-a8a5-3a121e802891 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.614928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f3f1-ce3c-47da-a8a5-3a121e802891 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.614928 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f3f1-ce3c-47da-a8a5-3a121e802891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.633268 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-f563f3f1-ce3c-47da-a8a5-3a121e802891 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:31.634480 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-f563f3f1-ce3c-47da-a8a5-3a121e802891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:31.642574 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1432/2850] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:31.666206 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2faee-3e41-4e6f-be1b-7915c73bbdce service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.677732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2faee-3e41-4e6f-be1b-7915c73bbdce service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.684188 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624250-e5c0-4276-ac83-3eacc45f159d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.684849 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624250-e5c0-4276-ac83-3eacc45f159d service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.685135 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624250-e5c0-4276-ac83-3eacc45f159d service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.685425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624250-e5c0-4276-ac83-3eacc45f159d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.695121 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4624250-e5c0-4276-ac83-3eacc45f159d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.696701 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4624250-e5c0-4276-ac83-3eacc45f159d service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:31.706227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1419/2851] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:39.831222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430fdb-e810-47e6-81a1-9a8cc373fdde None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:39.832167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430fdb-e810-47e6-81a1-9a8cc373fdde None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:39.832167 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430fdb-e810-47e6-81a1-9a8cc373fdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:39.851060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-b6430fdb-e810-47e6-81a1-9a8cc373fdde None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:39.852310 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b6430fdb-e810-47e6-81a1-9a8cc373fdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:39.860193 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1433/2852] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:39.891526 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624250-e5c0-4276-ac83-3eacc45f159d service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:39.903900 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624250-e5c0-4276-ac83-3eacc45f159d service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:39.909926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea05c38-8143-4c41-adcc-3578e49e736d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:39.910560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea05c38-8143-4c41-adcc-3578e49e736d service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:39.910880 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea05c38-8143-4c41-adcc-3578e49e736d service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:39.911166 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea05c38-8143-4c41-adcc-3578e49e736d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:39.919210 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea05c38-8143-4c41-adcc-3578e49e736d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:39.920769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea05c38-8143-4c41-adcc-3578e49e736d service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:39.929982 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1420/2853] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:42.995467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d931-6348-4e79-b858-fa006cc2696c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:42.996041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d931-6348-4e79-b858-fa006cc2696c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:42.996041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d931-6348-4e79-b858-fa006cc2696c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:43.014373 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-aa46d931-6348-4e79-b858-fa006cc2696c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:43.015617 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-aa46d931-6348-4e79-b858-fa006cc2696c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:43.024244 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1434/2854] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:43.050596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea05c38-8143-4c41-adcc-3578e49e736d service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:43.062583 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea05c38-8143-4c41-adcc-3578e49e736d service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:43.068746 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1ce1-fe4a-4942-8191-b4cbe576c1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:43.069398 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1ce1-fe4a-4942-8191-b4cbe576c1af service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:43.069687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1ce1-fe4a-4942-8191-b4cbe576c1af service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:43.069972 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1ce1-fe4a-4942-8191-b4cbe576c1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:43.078390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b1ce1-fe4a-4942-8191-b4cbe576c1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:43.080654 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b1ce1-fe4a-4942-8191-b4cbe576c1af service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:43.089986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1421/2855] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:46.139843 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a90a-9f95-42ac-b70d-99c5ea3ef93b None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:46.140358 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a90a-9f95-42ac-b70d-99c5ea3ef93b None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:46.140465 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a90a-9f95-42ac-b70d-99c5ea3ef93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:46.158933 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-23d3a90a-9f95-42ac-b70d-99c5ea3ef93b None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:46.160139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-23d3a90a-9f95-42ac-b70d-99c5ea3ef93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:46.168202 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1435/2856] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:46.189544 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1ce1-fe4a-4942-8191-b4cbe576c1af service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:46.200752 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1ce1-fe4a-4942-8191-b4cbe576c1af service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:46.206834 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807325-c68e-45a4-a57e-e24e9b817138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:46.207484 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807325-c68e-45a4-a57e-e24e9b817138 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:46.207799 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807325-c68e-45a4-a57e-e24e9b817138 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:46.208083 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807325-c68e-45a4-a57e-e24e9b817138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:46.216194 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62807325-c68e-45a4-a57e-e24e9b817138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:46.217772 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62807325-c68e-45a4-a57e-e24e9b817138 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:46.227221 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1422/2857] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:49.223300 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3a90a-9f95-42ac-b70d-99c5ea3ef93b None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:49.227968 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=19 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:49.233885 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3a90a-9f95-42ac-b70d-99c5ea3ef93b None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:49.238063 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5188e1b57154bcba6fa56978085741d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:49.238707 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:49.239022 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:49.239303 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:49.241060 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:49.254475 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:49.255941 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:49.267072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1436/2858] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:56.223020 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=82 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:59.261983 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=5 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:01.327281 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc54abd-1bf2-4698-a844-83f6b4398b61 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:01.327763 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc54abd-1bf2-4698-a844-83f6b4398b61 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:01.327870 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc54abd-1bf2-4698-a844-83f6b4398b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:01.346954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3bc54abd-1bf2-4698-a844-83f6b4398b61 None None] MFA Rules not processed for user `437a7df5b1ee456ba04ac1e73e817582`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:01.348172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3bc54abd-1bf2-4698-a844-83f6b4398b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:01.355744 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1423/2859] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:01.580620 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:01.582153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:01.594265 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b55a-b830-46b5-84ca-59672af255b8 service cinder] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:01.597733 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:01.598370 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:01.598654 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:01.598962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:01.601231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:01.610502 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:01.611981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:01.620153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1437/2860] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:01.937517 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc54abd-1bf2-4698-a844-83f6b4398b61 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:01.938992 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3bc54abd-1bf2-4698-a844-83f6b4398b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:02.011126 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc54abd-1bf2-4698-a844-83f6b4398b61 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:02.015936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:02.016587 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:02.016874 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:02.017155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:02.018937 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:02.030552 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:02.032187 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:02.042718 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1424/2861] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:04.011470 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:04.020235 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5900-7035-41f6-88e2-1292b5106272 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:04.024573 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:04.025225 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:04.025512 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:04.025791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:04.027597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:04.037120 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:04.038541 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:04.046532 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1438/2862] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:04.722871 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:04.735858 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174a80-4a45-4aaa-943e-2505c87b3f2f service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:04.742174 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605d874-4c82-4ddf-b138-c0fccde1ff54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:04.743498 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d874-4c82-4ddf-b138-c0fccde1ff54 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:04.743873 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d874-4c82-4ddf-b138-c0fccde1ff54 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:04.744147 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d874-4c82-4ddf-b138-c0fccde1ff54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:04.745964 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d605d874-4c82-4ddf-b138-c0fccde1ff54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:04.758797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605d874-4c82-4ddf-b138-c0fccde1ff54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:04.760687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605d874-4c82-4ddf-b138-c0fccde1ff54 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:04.772252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1425/2863] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:09.448832 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:09.463155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dedde7-9e18-42b2-865c-4d0dc96c03d9 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:09.468637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:09.469296 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:09.469581 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:09.469860 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:09.471660 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:09.484722 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:09.486291 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:09.497741 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1439/2864] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:14.767084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=41 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:15.356818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d082f10-4b5b-4f10-a2f0-df198d08a45c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:15.357023 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d082f10-4b5b-4f10-a2f0-df198d08a45c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:15.357306 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d082f10-4b5b-4f10-a2f0-df198d08a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:15.374962 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-8d082f10-4b5b-4f10-a2f0-df198d08a45c None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:15.376159 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8d082f10-4b5b-4f10-a2f0-df198d08a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:15.384450 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1426/2865] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:15.404566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:15.415931 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199a47e-f407-4432-8f69-481ee9c9ca1c service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:15.421392 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc872d-9216-49b9-87fc-852a9339608c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:15.422030 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc872d-9216-49b9-87fc-852a9339608c service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:15.422318 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc872d-9216-49b9-87fc-852a9339608c service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:15.422594 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc872d-9216-49b9-87fc-852a9339608c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:15.431168 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc872d-9216-49b9-87fc-852a9339608c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:15.432721 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc872d-9216-49b9-87fc-852a9339608c service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:15.442219 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1440/2866] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:18.623700 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036474b4-c4fd-496d-a32e-25861e8465bb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.624232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036474b4-c4fd-496d-a32e-25861e8465bb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.624232 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036474b4-c4fd-496d-a32e-25861e8465bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.641969 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-036474b4-c4fd-496d-a32e-25861e8465bb None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:18.643215 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-036474b4-c4fd-496d-a32e-25861e8465bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:18.651607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1427/2867] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:18.691211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc872d-9216-49b9-87fc-852a9339608c service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:18.702243 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc872d-9216-49b9-87fc-852a9339608c service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:18.707564 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8bc9e-ba64-476a-9315-280bd4075bc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:18.708222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8bc9e-ba64-476a-9315-280bd4075bc7 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.708508 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8bc9e-ba64-476a-9315-280bd4075bc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.708789 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8bc9e-ba64-476a-9315-280bd4075bc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.717210 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8bc9e-ba64-476a-9315-280bd4075bc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:18.718798 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8bc9e-ba64-476a-9315-280bd4075bc7 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:18.728615 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1441/2868] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:21.698331 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c6f73-a0e6-419e-a038-8b75c0e2cf2a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:21.698833 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c6f73-a0e6-419e-a038-8b75c0e2cf2a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:21.698954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c6f73-a0e6-419e-a038-8b75c0e2cf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:21.716349 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-955c6f73-a0e6-419e-a038-8b75c0e2cf2a None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:21.717574 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-955c6f73-a0e6-419e-a038-8b75c0e2cf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:21.725377 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1428/2869] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:21.775939 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8bc9e-ba64-476a-9315-280bd4075bc7 service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:21.786875 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8bc9e-ba64-476a-9315-280bd4075bc7 service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:21.792867 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11fbcf-598f-4655-aa73-c061cd72a749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:21.793503 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fbcf-598f-4655-aa73-c061cd72a749 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:21.793790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fbcf-598f-4655-aa73-c061cd72a749 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:21.794072 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fbcf-598f-4655-aa73-c061cd72a749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:21.801981 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11fbcf-598f-4655-aa73-c061cd72a749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:21.803580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11fbcf-598f-4655-aa73-c061cd72a749 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:21.813090 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1442/2870] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:24.840181 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ffd74-44b0-4404-b833-68c87412e383 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.840680 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ffd74-44b0-4404-b833-68c87412e383 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.840791 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ffd74-44b0-4404-b833-68c87412e383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.859104 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-da3ffd74-44b0-4404-b833-68c87412e383 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:24.860295 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-da3ffd74-44b0-4404-b833-68c87412e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:24.868021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1429/2871] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:24.894955 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11fbcf-598f-4655-aa73-c061cd72a749 service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:24.906140 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11fbcf-598f-4655-aa73-c061cd72a749 service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:24.911501 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f3b3-c469-4b81-a7aa-555f48389266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:24.912139 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f3b3-c469-4b81-a7aa-555f48389266 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.912426 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f3b3-c469-4b81-a7aa-555f48389266 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.912703 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f3b3-c469-4b81-a7aa-555f48389266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.921534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75f3b3-c469-4b81-a7aa-555f48389266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:24.923153 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75f3b3-c469-4b81-a7aa-555f48389266 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:24.933222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1443/2872] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:27.992396 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eec9e-56fb-42ea-98a2-f0a54be31561 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:27.992911 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eec9e-56fb-42ea-98a2-f0a54be31561 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:27.993022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eec9e-56fb-42ea-98a2-f0a54be31561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.012000 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7f9eec9e-56fb-42ea-98a2-f0a54be31561 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:28.013233 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7f9eec9e-56fb-42ea-98a2-f0a54be31561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:28.022314 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1430/2873] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Jul 12 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:28.049039 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f3b3-c469-4b81-a7aa-555f48389266 service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.061177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f3b3-c469-4b81-a7aa-555f48389266 service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.066738 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02b667-312b-43d0-9c56-47a76889ee91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.067416 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02b667-312b-43d0-9c56-47a76889ee91 service nova] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.067706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02b667-312b-43d0-9c56-47a76889ee91 service nova] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.067987 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02b667-312b-43d0-9c56-47a76889ee91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.076324 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02b667-312b-43d0-9c56-47a76889ee91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.077896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02b667-312b-43d0-9c56-47a76889ee91 service nova] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.087495 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1444/2874] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:44:38.006585 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=15 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:38.083074 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=48 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:56.652901 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eec9e-56fb-42ea-98a2-f0a54be31561 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:56.664596 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eec9e-56fb-42ea-98a2-f0a54be31561 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:56.669605 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:56.670264 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:56.670557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:56.670869 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:56.672668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:56.684303 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:56.685940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:56.697538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1431/2875] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:56.715205 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02b667-312b-43d0-9c56-47a76889ee91 service nova] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:56.726282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02b667-312b-43d0-9c56-47a76889ee91 service nova] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:56.731522 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:56.732477 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:56.732844 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:56.733217 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] PATH_INFO: `/v3/users/437a7df5b1ee456ba04ac1e73e817582` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:56.734732 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=437a7df5b1ee456ba04ac1e73e817582)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:56.737399 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:56.783708 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437a7df5b1ee456ba04ac1e73e817582'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:56.795607 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437a7df5b1ee456ba04ac1e73e817582'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:56.796276 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437a7df5b1ee456ba04ac1e73e817582'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:56.803369 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437a7df5b1ee456ba04ac1e73e817582'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:56.810233 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-e029d7eb-effa-4546-8978-61ca2b15ed9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437a7df5b1ee456ba04ac1e73e817582'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:56.817080 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1445/2876] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:56 2022] DELETE /identity/v3/users/437a7df5b1ee456ba04ac1e73e817582 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:56.991998 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.002760 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c4893-6aae-4f9b-b0a9-156065d556fe service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.060891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.062041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.062332 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.062615 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] PATH_INFO: `/v3/projects/8fada75f06eb4ebca951b77d81d7a55b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.063954 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fada75f06eb4ebca951b77d81d7a55b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.066557 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.111384 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fada75f06eb4ebca951b77d81d7a55b', 'request_id': 'req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:57.117970 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fada75f06eb4ebca951b77d81d7a55b', 'request_id': 'req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:57.123411 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fada75f06eb4ebca951b77d81d7a55b', 'request_id': 'req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:57.135770 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] The token cache is being invalidate because project 8fada75f06eb4ebca951b77d81d7a55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:57.136090 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:57.136710 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1bbe3d1e-f6fd-4cfb-b07e-dbc37c0d35dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:57.138260 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1432/2877] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:56 2022] DELETE /identity/v3/projects/8fada75f06eb4ebca951b77d81d7a55b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:57.143954 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527c615-33e3-4d49-b32b-e02bf8910f1d None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.144245 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527c615-33e3-4d49-b32b-e02bf8910f1d None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.144526 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527c615-33e3-4d49-b32b-e02bf8910f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.163907 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-0527c615-33e3-4d49-b32b-e02bf8910f1d None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:57.165148 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-0527c615-33e3-4d49-b32b-e02bf8910f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:57.231239 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1446/2878] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:57.240056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3a3e1-4644-4fe5-92f8-0e38beef0ef6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.240363 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3a3e1-4644-4fe5-92f8-0e38beef0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.240648 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3a3e1-4644-4fe5-92f8-0e38beef0ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.259101 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bcc3a3e1-4644-4fe5-92f8-0e38beef0ef6 None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:57.260313 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bcc3a3e1-4644-4fe5-92f8-0e38beef0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:57.268665 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1433/2879] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:57.272876 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527c615-33e3-4d49-b32b-e02bf8910f1d None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.283118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527c615-33e3-4d49-b32b-e02bf8910f1d None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.288263 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.288921 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.289207 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.289485 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.290211 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:44:57.290518 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.292163 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.304346 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1447/2880] 10.222.0.72 () {58 vars in 1152 bytes} [Tue Jul 12 14:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:44:57.308766 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3a3e1-4644-4fe5-92f8-0e38beef0ef6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.318634 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3a3e1-4644-4fe5-92f8-0e38beef0ef6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.323230 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8c6d-286a-4d46-9fd4-f0b424bf6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.323893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8c6d-286a-4d46-9fd4-f0b424bf6697 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.324179 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8c6d-286a-4d46-9fd4-f0b424bf6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.324459 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8c6d-286a-4d46-9fd4-f0b424bf6697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.325155 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8c6d-286a-4d46-9fd4-f0b424bf6697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.327117 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8c6d-286a-4d46-9fd4-f0b424bf6697 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.364732 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1434/2881] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:57 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:57.368763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.378886 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8c2f-5592-42ac-80f7-cc9bce35c2f2 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.435816 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58640e2-39cb-49a4-af7a-0b4d79a20bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.436758 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58640e2-39cb-49a4-af7a-0b4d79a20bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.437047 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58640e2-39cb-49a4-af7a-0b4d79a20bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.437356 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58640e2-39cb-49a4-af7a-0b4d79a20bbf admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.438048 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58640e2-39cb-49a4-af7a-0b4d79a20bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.440028 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58640e2-39cb-49a4-af7a-0b4d79a20bbf admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.446543 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:57.460469 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1448/2882] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:57 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:44:57.464550 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8c6d-286a-4d46-9fd4-f0b424bf6697 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.475424 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8c6d-286a-4d46-9fd4-f0b424bf6697 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.480007 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf361179-70c3-4bc1-ae5b-93eda33ce172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.480670 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361179-70c3-4bc1-ae5b-93eda33ce172 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.480961 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361179-70c3-4bc1-ae5b-93eda33ce172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.481245 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361179-70c3-4bc1-ae5b-93eda33ce172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.481975 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf361179-70c3-4bc1-ae5b-93eda33ce172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.483620 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf361179-70c3-4bc1-ae5b-93eda33ce172 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.494191 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1435/2883] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:57.497700 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58640e2-39cb-49a4-af7a-0b4d79a20bbf admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.507443 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58640e2-39cb-49a4-af7a-0b4d79a20bbf admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.511978 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821aa88-4f18-49c3-b992-8206ca08a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.512636 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821aa88-4f18-49c3-b992-8206ca08a27a admin admin] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.512915 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821aa88-4f18-49c3-b992-8206ca08a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.513194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821aa88-4f18-49c3-b992-8206ca08a27a admin admin] PATH_INFO: `/v3/roles` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.513911 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821aa88-4f18-49c3-b992-8206ca08a27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.515536 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821aa88-4f18-49c3-b992-8206ca08a27a admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.525175 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1449/2884] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:44:57.529172 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf361179-70c3-4bc1-ae5b-93eda33ce172 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.540009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf361179-70c3-4bc1-ae5b-93eda33ce172 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.544529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.545404 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.545689 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.545967 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] PATH_INFO: `/v3/projects/559441be400e4e8183e51b8c604f8b82/users/d29182fd0c574ab2a95d109a6f126d6f/roles/36219e61b6d84e06b7585b5dca9f1c95` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.561371 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559441be400e4e8183e51b8c604f8b82, user_id=d29182fd0c574ab2a95d109a6f126d6f, role_id=36219e61b6d84e06b7585b5dca9f1c95)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.564038 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.576641 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1436/2885] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:57 2022] PUT /identity/v3/projects/559441be400e4e8183e51b8c604f8b82/users/d29182fd0c574ab2a95d109a6f126d6f/roles/36219e61b6d84e06b7585b5dca9f1c95 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:57.582125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f888-3fc8-48f0-9f77-c47193b1c3de None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.582450 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f888-3fc8-48f0-9f77-c47193b1c3de None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.582736 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f888-3fc8-48f0-9f77-c47193b1c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.600525 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-2a71f888-3fc8-48f0-9f77-c47193b1c3de None None] MFA Rules not processed for user `117ad82133d0435087c48fd76e0b6541`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:57.601724 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-2a71f888-3fc8-48f0-9f77-c47193b1c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:57.658661 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1450/2886] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:57.668602 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.670273 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:57.676797 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:57.729668 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628359e8-733e-4c26-8ceb-34cd3667dd44 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.733253 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e95fb-aec0-4ccb-900f-41f8b7f4bdca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.733893 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e95fb-aec0-4ccb-900f-41f8b7f4bdca service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.734180 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e95fb-aec0-4ccb-900f-41f8b7f4bdca service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.734462 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e95fb-aec0-4ccb-900f-41f8b7f4bdca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.743344 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e95fb-aec0-4ccb-900f-41f8b7f4bdca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.744762 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e95fb-aec0-4ccb-900f-41f8b7f4bdca service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.754015 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1437/2887] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:01.901883 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188210-4ff1-4913-ac1c-b312c7e79f8c None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:01.903018 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188210-4ff1-4913-ac1c-b312c7e79f8c None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:01.903521 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188210-4ff1-4913-ac1c-b312c7e79f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:01.933151 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-db188210-4ff1-4913-ac1c-b312c7e79f8c None None] MFA Rules not processed for user `d29182fd0c574ab2a95d109a6f126d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:01.934423 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-db188210-4ff1-4913-ac1c-b312c7e79f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:02.022178 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1451/2888] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:02.026690 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e95fb-aec0-4ccb-900f-41f8b7f4bdca service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.037649 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e95fb-aec0-4ccb-900f-41f8b7f4bdca service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.042673 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f347a-3c64-4a55-9f58-8f136c8c279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.043506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f347a-3c64-4a55-9f58-8f136c8c279c admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.043936 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f347a-3c64-4a55-9f58-8f136c8c279c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.044457 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f347a-3c64-4a55-9f58-8f136c8c279c admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.045277 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f347a-3c64-4a55-9f58-8f136c8c279c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.047346 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f347a-3c64-4a55-9f58-8f136c8c279c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.075613 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1438/2889] 10.222.0.72 () {60 vars in 1152 bytes} [Tue Jul 12 14:45:02 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:02.079648 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db188210-4ff1-4913-ac1c-b312c7e79f8c None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.091744 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db188210-4ff1-4913-ac1c-b312c7e79f8c None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.150155 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b773c-ac81-4cf0-8934-bd127f25fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.150969 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b773c-ac81-4cf0-8934-bd127f25fed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.151258 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b773c-ac81-4cf0-8934-bd127f25fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.151534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b773c-ac81-4cf0-8934-bd127f25fed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.152231 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b773c-ac81-4cf0-8934-bd127f25fed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.154170 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b773c-ac81-4cf0-8934-bd127f25fed1 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.168102 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:02.175637 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1452/2890] 10.222.0.72 () {60 vars in 1143 bytes} [Tue Jul 12 14:45:02 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:02.179560 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f347a-3c64-4a55-9f58-8f136c8c279c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.190041 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f347a-3c64-4a55-9f58-8f136c8c279c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.195076 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec16a25-06a2-49a3-bee6-df65686f6559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.195734 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16a25-06a2-49a3-bee6-df65686f6559 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.196022 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16a25-06a2-49a3-bee6-df65686f6559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.196300 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16a25-06a2-49a3-bee6-df65686f6559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.197056 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec16a25-06a2-49a3-bee6-df65686f6559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.198646 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec16a25-06a2-49a3-bee6-df65686f6559 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.209231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1439/2891] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:02.213280 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b773c-ac81-4cf0-8934-bd127f25fed1 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.223665 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b773c-ac81-4cf0-8934-bd127f25fed1 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.228466 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13462f2e-c712-49d4-bc06-5c2a4b757260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.229372 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462f2e-c712-49d4-bc06-5c2a4b757260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.229656 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462f2e-c712-49d4-bc06-5c2a4b757260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.229932 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462f2e-c712-49d4-bc06-5c2a4b757260 admin admin] PATH_INFO: `/v3/projects/f17d81d9de0840b79d6332fe224a7fa2/users/53c2caeec8434ae9a29b3af6a21f2f07/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.244684 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13462f2e-c712-49d4-bc06-5c2a4b757260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17d81d9de0840b79d6332fe224a7fa2, user_id=53c2caeec8434ae9a29b3af6a21f2f07, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.247366 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13462f2e-c712-49d4-bc06-5c2a4b757260 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.260064 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1453/2892] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:45:02 2022] PUT /identity/v3/projects/f17d81d9de0840b79d6332fe224a7fa2/users/53c2caeec8434ae9a29b3af6a21f2f07/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:02.264189 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec16a25-06a2-49a3-bee6-df65686f6559 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.274271 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec16a25-06a2-49a3-bee6-df65686f6559 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.333686 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93771c-a4a8-47a1-baef-cde815d55b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.334378 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93771c-a4a8-47a1-baef-cde815d55b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.334674 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93771c-a4a8-47a1-baef-cde815d55b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.334991 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93771c-a4a8-47a1-baef-cde815d55b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.335751 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93771c-a4a8-47a1-baef-cde815d55b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.337441 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93771c-a4a8-47a1-baef-cde815d55b4f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.347781 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1440/2893] 10.222.0.72 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:02.351898 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13462f2e-c712-49d4-bc06-5c2a4b757260 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.363333 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13462f2e-c712-49d4-bc06-5c2a4b757260 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.367929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.368818 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.369105 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.369420 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] PATH_INFO: `/v3/projects/f17d81d9de0840b79d6332fe224a7fa2/users/53c2caeec8434ae9a29b3af6a21f2f07/roles/a684d812bd0e4947bda85bee1f00b8f5` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.371410 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17d81d9de0840b79d6332fe224a7fa2, user_id=53c2caeec8434ae9a29b3af6a21f2f07, role_id=a684d812bd0e4947bda85bee1f00b8f5)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.374076 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.384838 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1454/2894] 10.222.0.72 () {60 vars in 1482 bytes} [Tue Jul 12 14:45:02 2022] PUT /identity/v3/projects/f17d81d9de0840b79d6332fe224a7fa2/users/53c2caeec8434ae9a29b3af6a21f2f07/roles/a684d812bd0e4947bda85bee1f00b8f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:06.992353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542358de-ae38-40aa-9d53-63fb78ad071e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:06.992864 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542358de-ae38-40aa-9d53-63fb78ad071e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:06.992959 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542358de-ae38-40aa-9d53-63fb78ad071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:07.021622 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-542358de-ae38-40aa-9d53-63fb78ad071e None None] MFA Rules not processed for user `53c2caeec8434ae9a29b3af6a21f2f07`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:07.022872 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-542358de-ae38-40aa-9d53-63fb78ad071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:07.095432 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:07.111146 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1441/2895] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:45:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:07.119893 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:07.122004 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:07.202604 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec190ae8-6b84-49ef-ba82-f2c98a5197bd admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:07.206208 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a81dce4c3ffd42bd85bf6e7687b5cbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:07.206929 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:07.207216 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:07.207491 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:07.268411 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:07.269881 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:07.279269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1455/2896] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:07.375782 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04754e51-7e00-42c9-a746-02522de3fe40 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:07.376084 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04754e51-7e00-42c9-a746-02522de3fe40 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:07.376369 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04754e51-7e00-42c9-a746-02522de3fe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:07.433706 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-04754e51-7e00-42c9-a746-02522de3fe40 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:07.434965 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-04754e51-7e00-42c9-a746-02522de3fe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:07.506231 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1442/2897] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:07.553800 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:07.555467 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:07.615194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:07.648555 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfb8f6-aee1-4ee0-8b24-cec56ae3a8cc service glance] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:07.653626 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a0979-3796-44c3-9c07-b1b85efa4326 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:07.654282 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0979-3796-44c3-9c07-b1b85efa4326 service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:07.654566 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0979-3796-44c3-9c07-b1b85efa4326 service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:07.654877 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0979-3796-44c3-9c07-b1b85efa4326 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:07.663790 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0979-3796-44c3-9c07-b1b85efa4326 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:07.665381 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0979-3796-44c3-9c07-b1b85efa4326 service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:07.673690 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1456/2898] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:17.016341 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2198a-e352-4482-9549-1345c4e9ffa9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:17.016804 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2198a-e352-4482-9549-1345c4e9ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:17.016898 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2198a-e352-4482-9549-1345c4e9ffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:17.034687 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-56b2198a-e352-4482-9549-1345c4e9ffa9 None None] MFA Rules not processed for user `d29182fd0c574ab2a95d109a6f126d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:17.035920 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-56b2198a-e352-4482-9549-1345c4e9ffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:17.043017 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1443/2899] 10.222.0.72 () {58 vars in 957 bytes} [Tue Jul 12 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:17.670159 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=16 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:18.925133 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450d7f2-408a-44a9-ab56-b8016913f128 None None] REQUEST_METHOD: `POST` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:18.926181 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450d7f2-408a-44a9-ab56-b8016913f128 None None] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:18.926329 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450d7f2-408a-44a9-ab56-b8016913f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:18.951106 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.auth.core [None req-6450d7f2-408a-44a9-ab56-b8016913f128 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:18.952598 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-6450d7f2-408a-44a9-ab56-b8016913f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:18.960448 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1457/2900] 10.222.0.72 () {58 vars in 1009 bytes} [Tue Jul 12 14:45:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:18.972980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2198a-e352-4482-9549-1345c4e9ffa9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:18.985771 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2198a-e352-4482-9549-1345c4e9ffa9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:18.991607 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:18.992283 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:18.992577 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:18.992865 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:19.001826 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:19.003471 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:19.011940 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1444/2901] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:45:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:28.940801 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=3 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:29.008445 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=55 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:40.214253 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450d7f2-408a-44a9-ab56-b8016913f128 None None] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:40.267289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450d7f2-408a-44a9-ab56-b8016913f128 None None] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:40.270795 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d55b1fd69640548e7b35258e33e7cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:40.271434 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:40.271718 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:40.271995 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:40.280829 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:40.282257 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:40.291706 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1458/2902] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:41.795353 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:41.797227 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:41.887252 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767df4d-9d5c-48e3-9420-be2fbd9fb65e service swift] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:41.893218 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ffa1b-894b-41fa-8a83-c210fa36248e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7926b212faa44c228ff4ad9e63ee0287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:41.893891 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ffa1b-894b-41fa-8a83-c210fa36248e service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:41.894192 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ffa1b-894b-41fa-8a83-c210fa36248e service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:41.894883 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ffa1b-894b-41fa-8a83-c210fa36248e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:41.897294 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9b1ffa1b-894b-41fa-8a83-c210fa36248e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:41.910659 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ffa1b-894b-41fa-8a83-c210fa36248e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:41.912506 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ffa1b-894b-41fa-8a83-c210fa36248e service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:41.926820 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1445/2903] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:50.287505 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=26 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:51.922376 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=34 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:36.979444 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:46:36.980841 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:37.047353 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a5518-34b6-4e71-a7ad-3b624ab06cd1 service neutron] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:46:37.052802 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:46:37.053479 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:37.053763 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:37.054041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:37.055820 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:37.067900 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:46:37.069482 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:46:37.079337 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1459/2904] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:46:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:46:47.075142 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=32 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:12.178974 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d3b7-5319-411b-9632-e3b88458cc21 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:12.179425 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d3b7-5319-411b-9632-e3b88458cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:12.179529 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d3b7-5319-411b-9632-e3b88458cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:12.197584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4bc7d3b7-5319-411b-9632-e3b88458cc21 None None] MFA Rules not processed for user `6c7f048f7f1c4df1a9f6dca0fc4ce75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:47:12.198818 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4bc7d3b7-5319-411b-9632-e3b88458cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:12.206749 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1446/2905] 10.222.0.72 () {58 vars in 967 bytes} [Tue Jul 12 14:47:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:47:12.245962 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:12.257699 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cdfea-83a0-4a1a-83ec-3c77e41a4e4d service placement] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:12.262621 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648f4a-d10b-4f3d-a867-a488b271a83f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9422f3bea364469093eb4046b011017e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:12.263311 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648f4a-d10b-4f3d-a867-a488b271a83f service swift] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:12.263597 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648f4a-d10b-4f3d-a867-a488b271a83f service swift] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:12.263925 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648f4a-d10b-4f3d-a867-a488b271a83f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:12.272538 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648f4a-d10b-4f3d-a867-a488b271a83f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:12.274118 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648f4a-d10b-4f3d-a867-a488b271a83f service swift] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:12.281990 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1460/2906] 10.222.0.72 () {60 vars in 1384 bytes} [Tue Jul 12 14:47:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:47:15.566671 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7d3b7-5319-411b-9632-e3b88458cc21 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:15.587726 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7d3b7-5319-411b-9632-e3b88458cc21 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:15.593679 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:15.594472 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:15.594907 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:15.595312 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:15.597360 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:15.613530 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:15.614926 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:15.644133 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1447/2907] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:18.949856 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648f4a-d10b-4f3d-a867-a488b271a83f service swift] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:19.014032 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648f4a-d10b-4f3d-a867-a488b271a83f service swift] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:19.018603 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:19.019534 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:19.019821 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:19.020103 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] PATH_INFO: `/v3/users/d29182fd0c574ab2a95d109a6f126d6f` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:19.021289 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29182fd0c574ab2a95d109a6f126d6f)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:19.023269 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:19.071949 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29182fd0c574ab2a95d109a6f126d6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.084177 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29182fd0c574ab2a95d109a6f126d6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.084791 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29182fd0c574ab2a95d109a6f126d6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.092251 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29182fd0c574ab2a95d109a6f126d6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.099222 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29182fd0c574ab2a95d109a6f126d6f'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.105098 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1461/2908] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:47:18 2022] DELETE /identity/v3/users/d29182fd0c574ab2a95d109a6f126d6f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:47:19.280713 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:19.291390 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9473e-e8d8-4b31-93c8-d709f51010c2 service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:19.347887 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:19.348769 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:19.349061 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:19.349347 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] PATH_INFO: `/v3/projects/559441be400e4e8183e51b8c604f8b82` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:19.350540 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559441be400e4e8183e51b8c604f8b82)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:19.352519 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:19.399011 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559441be400e4e8183e51b8c604f8b82', 'request_id': 'req-edfc995f-9a4e-4694-b202-45419aaf04a8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.405980 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559441be400e4e8183e51b8c604f8b82', 'request_id': 'req-edfc995f-9a4e-4694-b202-45419aaf04a8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.411512 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559441be400e4e8183e51b8c604f8b82', 'request_id': 'req-edfc995f-9a4e-4694-b202-45419aaf04a8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.423724 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] The token cache is being invalidate because project 559441be400e4e8183e51b8c604f8b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:47:19.424019 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.424645 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.426440 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1448/2909] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:47:19 2022] DELETE /identity/v3/projects/559441be400e4e8183e51b8c604f8b82 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:47:19.430601 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:19.432056 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:19.445988 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924cf1-0757-44d4-9a53-e5a726066072 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:19.501631 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:19.502618 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:19.502845 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:19.503125 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] PATH_INFO: `/v3/users/53c2caeec8434ae9a29b3af6a21f2f07` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:19.504314 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c2caeec8434ae9a29b3af6a21f2f07)` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:19.506194 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:19.511936 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:19.556669 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c2caeec8434ae9a29b3af6a21f2f07'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.569861 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c2caeec8434ae9a29b3af6a21f2f07'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.570674 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c2caeec8434ae9a29b3af6a21f2f07'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.578114 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c2caeec8434ae9a29b3af6a21f2f07'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.586041 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.notifications [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c2caeec8434ae9a29b3af6a21f2f07'} {{(pid=80444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.592535 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1462/2910] 10.222.0.72 () {58 vars in 1223 bytes} [Tue Jul 12 14:47:19 2022] DELETE /identity/v3/users/53c2caeec8434ae9a29b3af6a21f2f07 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:47:19.762902 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:19.764538 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:19.777811 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc995f-9a4e-4694-b202-45419aaf04a8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:19.834808 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117ad82133d0435087c48fd76e0b6541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3334aa68e9e41b9ae01ceb2502f9b38', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:19.835694 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:19.835986 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:19.836270 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] PATH_INFO: `/v3/projects/f17d81d9de0840b79d6332fe224a7fa2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:19.837443 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17d81d9de0840b79d6332fe224a7fa2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:19.839430 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:19.851127 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:19.888406 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17d81d9de0840b79d6332fe224a7fa2', 'request_id': 'req-70e23a67-ea6f-4070-92c7-c279616d207a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.894488 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17d81d9de0840b79d6332fe224a7fa2', 'request_id': 'req-70e23a67-ea6f-4070-92c7-c279616d207a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.900004 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17d81d9de0840b79d6332fe224a7fa2', 'request_id': 'req-70e23a67-ea6f-4070-92c7-c279616d207a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.913100 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] The token cache is being invalidate because project f17d81d9de0840b79d6332fe224a7fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:47:19.913391 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.914009 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-70e23a67-ea6f-4070-92c7-c279616d207a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:47:19.915584 dv-cinder-836996-39-smb devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1449/2911] 10.222.0.72 () {58 vars in 1232 bytes} [Tue Jul 12 14:47:19 2022] DELETE /identity/v3/projects/f17d81d9de0840b79d6332fe224a7fa2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:47:29.588455 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:29.910021 dv-cinder-836996-39-smb devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:39.911162 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] Authenticating user token {{(pid=80444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:39.912580 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:40.025110 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94a47-9cba-4e40-84db-72fde8ad9be7 admin admin] Validating token access rules against request {{(pid=80444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:40.085784 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f974206-415f-42d8-b889-15b0074c18ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f63e307bc2f445dbaa67aac26dadbb64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd636ac1b7e8a43c99327013ee2511995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:40.086441 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974206-415f-42d8-b889-15b0074c18ff service placement] REQUEST_METHOD: `GET` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:40.086730 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974206-415f-42d8-b889-15b0074c18ff service placement] SCRIPT_NAME: `/identity` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:40.087040 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974206-415f-42d8-b889-15b0074c18ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:40.088896 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.fernet_utils [None req-1f974206-415f-42d8-b889-15b0074c18ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:40.100084 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f974206-415f-42d8-b889-15b0074c18ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:40.101675 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f974206-415f-42d8-b889-15b0074c18ff service placement] RBAC: Authorization granted {{(pid=80444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:40.112067 dv-cinder-836996-39-smb devstack@keystone.service[80444]: [pid: 80444|app: 0|req: 1463/2912] 10.222.0.72 () {60 vars in 1365 bytes} [Tue Jul 12 14:51:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:51:50.107780 dv-cinder-836996-39-smb devstack@keystone.service[80444]: DEBUG dbcounter [-] [80444] Writing DB stats keystone:SELECT=77 {{(pid=80444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}